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ABSTRACT 

Evaluation of the White Bear Lake Senior High School 
New Design Program made by the Educational Research and Development 
Council of the Twin Cities Metropolitan Area, Inc. is presented. Sets 
of objectives were formulated for students, graduates, staff and 
community during a three-day workshop. Measurements devices used were 
questionnaires for students, teachers, and randomly selected 
community residents; Iowa Test of Educational Development for all 
seniors; personal interviews with 50 parents and 50 non-parents; a 
school survey inventory for teachers; and a questionnaire for 
graduates for the past five years. Areas are identified as strength, 
acceptable, or problem areas. The community indicated concern over 
student freedom and had a negative attitude toward the teachers. The 
teachers widely accept the New Design even though they express a 
desire for closer relations with the students. The students* general 
impression of the program is good. Achievement tests indicate that 
the learning rate does not differ significantly from the typical 
groups of seniors nationally. The graduates indicated that they 
received an education that adequately prepared them for life. (DJ) 
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INTRODUCTION 



The past decade has witnessed profound change and innovation in 
curricular and instructional programs in our public schools as well as 
organizational restructuring to implement these new designs. Modular 
flexible scheduling, individualized instruction, team teaching, and the 
use of performance curriculums are but a few of the many components of 
these designs. Educators and their local constituencies feel the need 
to examine the products of their recent efforts in educational innovation 
in order to make decisions regarding modification and/or continuation of 
the new programs. The present decade will become one of accountability 
where those responsible for school programs must find answers to the 
questions: 'tyhat evidence is there that the program achieves its 

objectives?" "To what extent are the objectives achieved?" "is it 
worth the cost?" Providing data to help answer these and other similar 
questions has become the primary focus of evaluation efforts. These 
efforts are geared to the gathering of information to give decision makers 
data essential for sound, effective decisions. 

White Bear Lake Senior High School, a school on the national fore- 
front of new innovation, moved to a new program design in the 1967-68 
school year. This "New Design" was based on a coordination of the 
educational concepts and models of Trump and Allen. ^ Under the director- 
ship of Dr. Fred Rohde, the school district has conducted an internal 
evaluation of its senior high school program. The school board has 
requested the Educational Research and Development Council of the Twin 
Cities Metropolitan Area, Inc. (ERDC) to supplement this study in order 
to evaluate the impact of the "New Design." 

STATEMENT OF THE PROBLEM 

An evaluation study should identify changes due to the implementation 
of the new program. Ideally some type of comparative data should be used. 



^For such concepts and models see Bush, R.N, and Allen, Dwight, A New Design 
for High School Education . McGraw-Hill Book Co., New York, N.Y., 1964, and/or 

Trump, J. Lloyd and Boynham, Dorsey, Guide to Better Schools : Focus on 

Change , Rand McNally and Company, Chicago, 1961. 
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This could take the form of a control group ( a similar school not using 
components of the New Design) or a comparison of pre and post test data 
(change over time due to the New Design). In White Bear Lake, as in 
most real situations, neither of these methods are feasible because base 
line data are not available, and comparable schools either do not exist 
or are not readily accessible* A new evaluation strategy was proposed 
(See Appendix A) which would examine the high school program by precisely 
determining the degree to which the goals of the new program have been met. 

As stated in the report of the internal evaluation of the White Bear 
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Lake school, the following are the five objectives of their "New Design": 

1* To individualize instruction by focusing on the individual student 
through the use of performance curriculum. 

2* To offer an expanded program to students by permitting and 

encouraging them to enroll in additional courses for credit or 
noncredit. 

3. Better staff utilization through the team approach and use of 
teacher assistants, teaching interns, teacher aids, instructional 
secretaries, material specialists, and a comprehensive inservice 
education program. 

4. To make change possible as the need arises through the use of 
flexible modular scheduling. 

5. To teach students to become more responsible for their own 
learning through the use of independent study. 

The evaluation strategy was built upon the development of specific 
objectives that would measure these overall objectives of the program. 

The degree to which the objectives are achieved would be an indication 
of the success of the high school program and would indicate components 
of the New Design needing modification and improvement. 

PROCEDURE 

Formulation of specific objectives and determination of standards for 
measuring the degree to which the objectives have been achieved demands the 
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Evaluation of White Bear Lake Senior High School Instructional Design , 
1968-69 , White Bear Lake Senior High School, White Bear Lake, Minnesota, 
1969, (mimeo) . 
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input from professionals with extensive knowledge of the New Design and its 
implementation. Therefore, the coordinated effort of the evaluation team 
from ERDC and the evaluation committee from White Bear Lake Senior High 
School were required to develop and set criterion levels for the objectives. 

Sets of objectives were formulated for students, graduates, staff, and 
community during a three day workshop in June. (A summary of the 3-day 
workshop in found in Appendix b) • 

With several sets of objectives in hand the ERDC evaluation team set 
out to eliminate duplicates, consolidate overlap, and clarify and refine all 
objectives. A total of 163 objectives together with desired performance 
levels were developed to serve as the guideline for the evaluation. (Some 
of these objectives could not be tested because of the scope of the evaluation 
project.) 

Uaing these refined objectives as a base for measurement, instruments 
and techniques were selected and developed for gathering data. (See Appendix C) 
Review of the instruments, agreement on the specific refined objectives, and 
consensus on the criterion levels were accomplished in a day's workshop by 
the evaluation committee of the school system with the aid of the evaluation 
team. 

The development and selection of the instruments resulted in the 
following data gathering devices: 

1. Questionnaires for all students, teachers, and 300 randomly selected 
community residents. All three questionnaires contain a common core 
of 25 questions plus individual components for each specific referent 
group. 

2. A community questionnaire to be used through a personal interview 
technique for $0 parents and 50 non-parents randomly selected. 

3. The Iowa Test of Educational Development for all seniors. 

4. The School Survey, a standardized 120 item inventory for all teachers 
covering opinions and attitudes about their work. 

5. A questionnaire for all graduates of the past five years including 
questions to measure specific White Bear Lake objectives. 

In addition to the instruments mentioned above, structured observational 
techniques were used in the classroom and school environment to supplement the 
data obtained through this instrumentation. 
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Data was gathered during the five-month period of October -February , 
1970-71. The community interviews were conducted in October and November 
by four professional educators with training in interview techniques. The 
paper and pencil tests, questionnaires, and inventories were administered 
by school personnel in December. On-site observation and interviews were 
conducted in January and February. All data collected was statistically 
summarized and matched with the specific objectives and desired criterion 
levels. Results of these comparisons are found in the next section, "Results-" 
(A flow diagram of the entire evaluation procedures is found in Appendix B). 
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RESULTS 

In the following sections the results of the data gathered through 
questionnaires, community interviews, achievement tests, and on-site 
observations are presented. It is well to remind oneself again that 
the purpose of evaluation is to provide information to assist in making 
effective school decisions. Accordingly, a variety of kinds of information 

f 

are presented in this report. A careful examination of the data is 
necessary to maximize the usefulness of this evaluation report. The 
responses to each item will bear on various school decisions; and staff 
in decision-making positions must examine the data carefully. However, 
for the purpose of summarizing the findings, part of this section shall 
concern itself with a synopsis of results. This synopsis is based upon 
the tables of data that follow. In this way a general summary of the 
strength and problem areas of the system is presented. 

The procedure used in the results section is to list items from 
the data -gathering instruments together with the apriori determined 
desired favorable levels, the percent of favorable responses, and a 
rating of the results. The ratings will take one of three forms. If 
the desired level has been exceeded by more than. 10 percentage points, 
this is defined as a strength area. If the percent favorable response 
is within a range spanned by the desired level plus or minus 10 percentage 
points, this is considered an acceptable rating. If, on the other hand, 
the percent favorable response was less than 10 percentage points below 
the desired level, thii. is considered a problem area. The choice of the 
10 percentage points as the cut-off levels is based upon tests of statistical 
difference. For a complete listing of the responses, the reader is referred 
to Appendix C. However, for summary purposes, items, desired favorable 
levels, and response levels are presented in the following tables. The 
results section is divided into four categories: Community, Teache-s, 

Students, and Graduates. 

COMMUNITY 

Data about community attitudes were gathered by two methods. First, a 
paper and pencil questionnaire was mailed to a scientifically selected 
sample of 300 people in the White Bear Lake school district. A to'/al of 
143 persons returned usable questionnaires. The second method used to 
assess community attitude was through direct interview with a random sample 
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of 100 adults in the community. A total of 94 adult interviews were 
obtained in this manner. 

Table 1 presents the summary of the Community Quest ionnaire* • 

There appears to be a strong favorable impression in the overall quality 
of the school as evidenced by the response to Item No. 10. Additional 
strength areas are indicated by the knowledge of the system* s goals and 
structure, particularly through Items 13, 16, 18, 19, and 22. These 
items refer to various components of flexible modular scheduling in which 
the community attitude appears to be quite positive. This includes such 
things as the variety of course offerings, the value of team teaching, and 
the value of individualized instruction. Strength is also indicated in 
the extracurricular activity area. 



NOTE: Interpretation of Results in Tables 

All percentages are listed as desired 
and obtained favorable levels regardless of 
the specific response. Thus, a favorable 
response to a positive statement about the 
school* s program is **Agree (A)**, while a 
favorable response to a negative statement 
is **Disagree (D)**. Similarily, a i’fcvdrable 
response to a negative adjective such as 
Unnecessary** is not to respond. 

This procedure of using only favorable 
response levels is done in the tables to 
allow the reader to easily identify problem 
and strength areas. If the response level 
exceeds the desired level in absolute value, 
it approaches a strength area in the program. 
If, however, the response level falls below 
the desired level, it approaches a problem 
area • 

If necessary, the reader should refer 
to the appropriate instrument in Appendix C 
for identification of favorable responses. 
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TABLE I 

Summary of Community Questionnaires 
N = 142 



Desired % 

Favorable Favorable 
Response Response 



1 . 


All students should have the opportunity to 
attend a school with modular scheduling. (A) 


507. 


427. 


2. 


The senior high school has better teachers than 
other area high schools. (A) 


507. 


537. 


3. 


Students are given too much responsibility for 
their own learning. (D) 


507. 


397. 


4. 


There are more discipline problems among our 
students than in other schools . (D) 


757. 


767. 


5. 


The majority of our students are satisfied with 
the school. (A) 


907. 


627. 


6. 


Most of our teachers care more for getting high 
salaries than for improving students' learning. (D) 


757. 


577. 


7. 


The school facilities are inadequate for present 
needs as to size and design. (D) 


907. 


497. 


8. 


Students are evaluated and graded fairly. (A) 


757. 


767. 


9. 


The tax dollar is being well spent on the high 
school. (A) 


507. 


537. 


10. 


The senior high school is providing quality 
education for the children of the community. (A) 


507. 


787. 


11. 


Less independent study time should be given to 
students. (D) 


907. 


407. 


12. 


Use of individual performance standards to judge 
student progress tends to lower the quality of 
work produced. (D) 


807. 


63% 


13. 


Too many different courses are offered in the 
high school. (D) 


757. 


86% 


14. 


More than half of their independent study time 
is wasted by students. (D) 


807. 


297. 


15. 


Too much emphasis is placed on inter-scholastic 
athletics. (D) 


50J 


717. 


16. 


Students can learn better in a regular class 
than through individualized instruction. (D) 


507. 


68% 


17. 


Team teaching contributes to improved student 
learning . (A) 


607. 


68% 


18. 


Students should be limited to a maximum of four 
courses at any one time. (D) 


607. 


83% 


19. 


Listening to the teacher lecture is the best way 
for high school students to learn. (D) 


507. 


867. 


20. 


Teachers are readily available to consult with 
individual students. (A) 


807. 


37% 



-r o 



Rating 

Acceptable 

Acceptable 

Problem Area 

Acceptable 

Problem Area 

Problem Area 

Problem Area 
Acceptable 

Acceptable 

Strength Area 

Problem Area 

Problem Area 
Strength Area 
Problem Area 
Strength Area 
Strength Area 
Acceptable 
Strength Area 
Strength Area 
Problem Area 
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TABLE I 


Desired 

Favorable 


7. 

Favorable 


Page 2 . 






Response 


Response 


Rating 


21. 


Instructional secretaries, teacher aides, media 










specialists, and other supportive staff are too 
costly for the value they provide. (D) 


90% 


607. 


Problem Area 


22. 


The most useful component of modular scheduling 
is the small group. (A) 


507. 


847. 


Strength Area 


23. 


There should be no required courses in senior 










high school. 


(Information item; 


see appendix) 


24. 


I would recommend our high school to a friend. 


00 

< 


757. 


Acceptable 


25. 


There is an adequate variety of extracurricular 
activities for students. (A) 


757. 


887. 


Strength Area 


Part 


II 








1 . 


Buildings and facilities 


807. 


757. 


Acceptable 


2. 


Job placement 


807. 


807. 


Acceptable 


3. 


Athletic program 


807. 


947. 


Strength Area 


4. 


Student control 


807. 


547. 


Problem Area 


5. 


School administration 


807. 


757. 


Acceptable 


6. 


Individualized instruction 


807. 


617. 


Problem Area 


7. 


Curriculum 


807. 


897. 


Acceptable 


8. 


Teachers' salary 


807. 


917. 


Strength Area 


9. 


Career information 


807. 


687. 


Problem Area 


10. 


Extracurricular activities 


807. 


947. 


Strength Area 


11. 


Instruction 


807. 


787. 


Acceptable 


12. 


Resource materials 


807. 


887. 


Acceptable 


13. 


School board decision making 


807. 


737. 


Acceptable 


14. 


Personal counseling 


807. 


667. 


Problem Area 


15. 


Parent -teacher communication 


807. 


627. 


Problem Area 




Desired 7. 


Desired 7. 





Part III . Favorable Favorable 



Favorable Favorable 



Response 


Response 


Rating 


Response 


Response 


Rating 


Useful 


757. 


377. 


Problem 


Unnecessary 


757. 


717. 


Acceptable 


Expensive 


757. 


717. 


Acceptable 


Valuable 


757. 


297. 


Problem 


Innovative 


757. 


347. 


Problem 


Rigid 


757. 


987. 


Strength 


Harmful 


757. 


707. 


Acceptable 


Traditional 


757. 


1007. 


Strength 


Dangerous 


757. 


827. 


Acceptable 


Poor 


757. 


667. 


Acceptable 


Effective 


757. 


287. 


Problem 


Ind i vid ua li z ing 


757. 


337. 


Problem 


Impersonal 


757. 


66% 


Acceptable 


Adequate 


757. 


197. 


Problem 


Old 


757. 


1007. 


Strength 


Extravagant 


757. 33 


837. 


Acceptable 


Stimulating 


75% 


327. 


Problem 











On the other side of the coin, several problem areas are suggested. 
Perhaps the most prevalent of these is the concern over student freedom 
under the new system. This feeling is perhaps most typically illustrated 
in a 71 percent belief in the statement that "More than half of their 
independent study time is wasted by students." 

A serious problem area is the general negative attitude held toward 
teachers (see Item 6 and 20) . Other problem areas are indicated in the 
general area of inadequate facilities (7), reeded improvement in student 
guidance opportunities (39), high cost of instructional secretaries, 
teacher aides, and the like (21), the community perception of student 
satisfaction with the new system (5), and parent -teacher communication (38) 

It is also important to note the particular items that reach the 
desired levels and are rated as adequate in Table 1. An example is the 
75 percent agreement to the statement "i would recommend our high school 
to a friend." While these will not be discussed individually, decision- 
makers should consider the attainment of the desired level as a positive 
reaction toward the school system and the new program. 

Additional information concerning community attitude toward the 
White Bear Lake Senior High School was obtained using community interviews. 
The results of the interviews are presented in Table 2. Again, items are 
listed together with the desired favorable level, the percent favorable 
response, and the suggested rating. 
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TABLE II 

Summary of Community Interviews 



N = 94 Desired % 





Favorable 

Response 


Favorable 

Response 


Rating 


2. . 


What type of program does White Bear Lake Senior 
High School have? (Flexible modular) 


75% 


94% 


Strength Area 


3. 


White Bear Lake Senior High School has: (Yes) 

A work-release program 


75% 


87% 


Strength Area 




More than one teacher for a single course 


75% 


61% 


Problem Area 




Open campus (No) 


75% 


67% 


Acceptable 




Possibility to complete high school in two years 


75% 


33% 


Problem Area 




A grading system with nc failures 


75% 


44% 


Problem Area 




Rating of students based on individual merit 


75% 


63% 


Problem Area 




A planned program for parents to visit the school 


75% 


78% 


Acceptable 




Specially designed small group instruction 


75% 


82% 


Acceptable 


4. 


Have you ever done any of the following? 

Participated in a visitation program at the school 


35% 


31% 


Acceptable 




Attended a school board meeting 


35% 


11% 


Problem Area 




Talked to a teacher regarding the program 


35% 


42% 


Acceptable 




Attended PTA, or other education meetings 


35% 


51% 


Strength Area 


5. 

6. 


(Information item; see appendix) 

In general, do you prefer the new design or the 
traditional program? (New) 


60% 


46% 


Problem Area 


7. 


In general, do the students like or dislike the 
high school program? (Like) 


60% 


67% 


Acceptable 


8. 


How does White Bear Lake Senior High School 
compare with other suburban schools? (Above average) 


60% 


66% 


Acceptable 


9. 


Is White Bear Lake Senior High School providing 
students with the background for success in college? 


60% 


84% 


Strength Area 


10. 


Is White Bear Lake Senior High School providing 
saleable skills for job entry? (Yes) 


60% 


77% 


Strength Area 


11. 


What is your opinion of the extra-curricular 
activities at White Bear Lake Senior High? (Sufficient) 75% 


90% 


Strength Area 


12. 


How much independent study time should senior 
high school students have? (Some of his time) 


60% 


55% 


Acceptable 


13. 


How much freedom does the student have under the 
new design? (About right) 


60% 


31% 


Problem Area 


14. 


How is control of students or discipline? (About right )60% 


47% 


Problem Area 


15 

20. 


- 19 (Information items; see appendix) 

Is the administration sensitive or insensitive to the 
community's educational needs and desires? (Sensitive)6Q% 


7 7% 


Strength Area 



21-24 (Information items; see appendix) 
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Several strength areas have been identified as a result of the 
community interviews. These include an indication of community interest 
as evidenced by their attendance at educational group meetings, a knowledge 
of the flexible modular scheduling system used in the high school, and a 
strong perception of the worth of the extracurricular activity program. 

The preparation function of the school for either college or for entering 
a Job is given a very strong endorsement as indicated by the responses to 
Items 9 and 10. In addition, the community perceives the administration 
of the school to be sensitive to the community needs. 

Although some components of the New Design ire understood by the 
community, a number of them do not realize the many varied components 
of the pchool. This is evidenced by the low response to items concerning 
the possibility to complete high school in two years, and a grading system 
with no failures. Also, 33 percent incorrectly thought White Bear Lake 
High School has an open campus. Another problem is indicated by the fact 
that only 11 percent of the community has ever attended a school board 
meeting . 

Responses to Item 6 where only 46 percent say they prefer the new 
design to the traditional indicates a real problem area. The discipline 
and lack of responsibility mentioned in the written questionnaire are 
supported through the interview questionnaire. The community is concerned 
about apparent lack of discipline of the students and the failure of students 
or the school to accept the responsibility given them in the large amount 
of independent time. Questions 13 and 14 particularly highlight this 
community concern. 

Again, it must be pointed out that the several items that attain 
an acceptable rating indicate a positive attitude toward the school system. 

It appears that the community in general is knowledgeable about the program 
and has a general overall favorable impression. It seems that both the 
school board and the administration would be well advised to inform the 
community what steps are being taken in the problem areas or to present 
a philosophical justification for the freedom provided studenta and the 
need for studenta to learn how to asaume the responsibility for their own 
time . 
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TEACHERS 



Attitudes of teachers toward the White Bear Lake High School and 
toward the New Design were assessed using two instruments; the Senior 
High School Questionnaire for teachers and an externally developed instrument 
called the School Survey. The first 59 items of the High School Questionnaire 
are identical to those found on the Community Questionnaire and also the 
same as those found on the Student Questionnaire to be described in the 
next section. In addition, there were items designed specifically for 
teachers. The responses of the teachers to the items of the questionnaire 
are summarized in Table 3. For a complete listing of the results of this 
questionnaire, the reader is referred to Appendix C. Again, the same rating 
system was used as in the previous section; that is, the item, desired 
favorable level, the percent of the favorable response, and the rating are 
listed. The achievement of the objective is then rated according to the 
code; strength area, problem area, or acceptable. 

As in the analysis of the previous questionnaire, an objective wcs 
considered to be achieved if the responses were within 10 percentage 
points of the desired level. If the response was greater than 10 percentage 
points of the desired level, this suggested that the objective being tested 
was being exceeded. Similarly, if the response was more than 10 points 
less than the desired level, this indicated a problem area because of the 
failure of the objective to be achieved. 

It is possible to summarize the attitudes of the teacher toward the 
school system and the Mew Design in the following ways. Responses to several 
items suggest that the New Design is widely accepted by the teachers. They 
see the value of team teaching, they are in agreement with the need for a 
variety of courses, and they see the value of small groups. In addition, 
the responses to Part 3 of this Teacher Questionnaire indicate a general 
favorable impression of the value of the New Design. This is also suggested 
by the many adequate and strong responses to the items of Part 5. 

As with the community, the teachers perceived the athletic program 
to be strong as well as the program of extracurricular activity. Finally, 
the positive response to the item concerning the expenditure of tax dollars 
suggests that the teachers believe that the system is operating at an 
efficient level. 



TABLE III 



Summary of Teacher Questionnaires 



N = 143 Desired 7. 







Favorable 

Response 


Favorable 

Response 


Rating 


1. 


All ‘students should have the opportunity to 
attend a school with modular scheduling. (A) 


957. 


767. 


Problem Area 


2. 


The senior high school has better teachers than 
other area high schools. (A) 


907, 


647. 


Problem Area 


3. 


Students are given too much responsibility for 
their own learning. (D) 


507. 


527. 


Acceptable 


4. 


There are more discipline problems among our 
students than in other schools. (D) 


75% 


737. 


Acceptable 


5. 


The majority of our students are satisfied with 
the school . (A) 


90% 


737. 


Problem Area 


6. 


Most of our teachers care more for getting high 
salaries than for improving students' learning. 


(D) 90% 


907. 


Acceptable 


7. 


The school facilities are inadequate for present 
needs as to size and design. (D) 


90% 


67. 


Problem Area 


8. 


Students are evaluated and graded fairly. (A) 


757. 


767. 


Acceptable 


9. 


The tax dollar is being well spent on the high 
school. (A) 


50% 


647. 


Strength Area 


10. 


The senior high school is providing quality 
education for the children of the community. (A) 


90% 


847. 


Acceptable 


11. 


Less independent study time should be given to 
students. (D) 


90% 


39% 


Problem Area 


12. 


Use of individual performance standards to judge 
student progress tends to lower the quality of 
work produced. (D) 


807. 


80% 


Acceptable 


13. 


Too many different courses are offered in the 
high school. (D) 


75% 


79% 


Acceptable 


14. 


More than half of their independent study time 
is wasted by students. (D) 


807. 


34% 


Problem Area 


15. 


Too much emphasis is placed on inter-scholastic 
athletics. (D) 


507. 


687. 


Strength Area 


16. 


Students can learn better in a regular class 
than through Individualized instruction. (D) 


90% 


817. 


Acceptable 


17. 


Team teaching contributes to improved student 
learning. (A) 


60% 


787. 


Strength Area 


18. 


Students should be limited to a maximum of four 
courses at any one time. (D) 


607. 


94% 


Strength Area 


19. 


Listening to the teacher lecture is the best way 
for high school students to learn. (D) 


907. 


997. 


Acceptable 


20. 


Teachers are readily available to consult with 
individual students. (A) 


807. 


66% 


Problem Area 
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Desired 

Favorable 

Response 


7. 

Favorable 

Response 


Rating 


21. 


Instructional secretaries, teacher aides, media 
specialists, and other supportive staff are too 
costly for the value they provide. (D) 


907o 


90% 


Acceptable 


• 

<M 

CM 


The most useful component of modular scheduling 
is the small group. (A) 


507 o 


71% 


Strength Area 


23. 


There should be no required courses in senior 
high school. 


(Information item; 


; see appendix) 


24. 


I would recommend our high school to a friend. (A) 


807, 


82% 


Acceptable 


25. 


There is an adequate variety of extracurricular 
activities for students. (A) 


757, 


92% 


Strength Area 


Part 

1. 


II 

Buildings and facilities 


807, 


17% 


Problem Area 


2. 


Job placement 


807. 


877. 


Acceptable 


3. 


Athletic program 


80% 


95% 


Strength Area 


4. 


Student control 


807. 


407. 


Problem Area 


5. 


School adminis tration 


807. 


82% 


Acceptable 


6. 


Individualized ins true tion 


807. 


587. 


Problem Area 


7. 


Curriculum 


807, 


65% 


Problem Area 


8. 


Teachers 1 salary 


807. 


787. 


Acceptable 


9. 


Career information 


807. 


897. 


Acceptable 


10. 


Extracurricular activities 


807. 


967, 


Strength Area 


11. 


Instruc tion 


807. 


777. 


Acceptable 


12. 


Resource materials 


807. 


847. 


Acceptable 


13. 


School board decision making 


807, 


687. 


Problem Area 


14. 


Personal counseling 


807. 


657. 


Problem Area 


15. 


Parent- teacher communication 


807, 


457. 


Problem Area 





Desired 


7. 






Desired 


7. 




Part III 


Favorable 


Favorable 




Favorable 


Favorable 






Response Response 


Rating 




Response 


Response 


Rating 


Useful 


75% 


747. 


Acceptable 


Unnecessary 


757. 


967, 


Strength 


Expensive 


757. 


667. 


Acceptable 


Valuable 


757. 


627. 


Problem 


Innovative 


757. 


737. 


Acceptable 


Rigid 


757. 


907. 


Strength 


Harmful 


757. 


887. 


Strength 


Traditional 


757. 


997. 


Strength 


Dangerous 


757. 


917. 


Strength 


Poor 


757. 


927. 


Strength 


Effective 


757. 


597, 


Problem 


Individualizing 757. 


667. 


Acceptable 


Impersonal 


757. 


877. 


Strength 


Adequate 


757. 


187. 


Problem 


Old 


757. 


1007. 


Strength 


Extravagant 


757. 


947. 


Strength 


Stimulating 757. 


607. 


Problem 
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TABLE III 



Desired % 

Favorable Favorable 
Response Response 



1. 


I know my students better under the modular 
schedule than I did under a traditional program, (A) 


807, 


52% 


2. 


This evaluation of the high school is a waste of 
money. (D) 


90% 


00 

00 


3. 


Written behavioral objectives are useful in teaching 
my courses. (A) 


85% 


78% 


4. 


The in-service programs have improved my teaching. (A) 


90% 


61% 


5. 


The faculty senate is a waste of time. (D) 


7 5% 


78% 


6. 


My students proceed through the class materials at 
the same pace throughout the year. (D) 


90% 


86% 


7. 


I use written student evaluations of my courses to 
improve instruction. (A) 


80% 


73% 


8. 


The majority of school decisions are made without 
consulting teachers. (D) 


7 5% 


58% 


9. 


I prefer traditional scheduling to modular 
scheduling. (D) 


7 5% 


87% 


1C. 


The N grade should be abolished. (D) 


7 5% 


70% 


11. 


With what percent of your students have you had a 
private conference this year? 


90%/ 90% 


18%/ 90% 


12. 


Check which of the following supportive staff are 
not being used effectively: 







clerical staff 




90% 


93% 


interns 




90% 


68% 


media and material specialists 




90% 


70% 


13. Do you enjoy teaching at White Bear Lake 


Senior High? 


90% 


92% 


Part V (Caused by New Plan Figures - Information item; 


see Appendix) 


1. Higher teacher salaries 




75% 


89% 


2. More discipline problems 




75% 


58% 


3. Improved learning 




75% 


68% 


4. More individualized instruction 




75% 


87% 


5. Improved administration 




7 5% 


64% 


6. Better facilities 




75% 


43% 


7. Poorer athletic teams 




75% 


94% 


8. Greater professional role for teachers 




75% 


70% 


9. More staff assistance 




75% 


85% 


10. Better student-teacher relations 




75% 


66% 


11. Less challenging teaching 




75% 


92% 


12. More teacher freedom 




75% 


82% 


13. Differentiated staffing 




75% 


46% 


14. Greater variety of media used 




75% 


87% 


15. More courses for students 




75% 


92% 


16. Fewer in-service programs 




75% 


95% 


17. Better teacher-teacher relations 




75% 


36% 


18* More student responsibility 


' * A 


75% 


77% 


19. Less school spirit 


u 


75% 


47% 



Page 3 



Rating 



Problem Area 

Acceptable 

Acceptable 
Problem Area 
Acceptable 

Acceptable 

Acceptable 

Problem Area 

Strength Area 
Acceptable 

Problem Area 



Acceptable 
Problem Area 
Problem Area 

Acceptable 



Strength Area 
Problem Area 
Acceptable 
Strength Area 
Acceptable 
Problem Area 
Strength Area 
Acceptable 
Strength Area 
Acceptable 
Strength Area 
Acceptable 
Problem Area 
Strength Area 
Strength Area 
Strength Area 
Problem Area 
Acceptab le 
Problem Area 
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In the problem area, which we have defined as objectives that are 
not being achieved, we note several places where future action is suggested. 
Perhaps most apparent of these is the need for improved facilities in the 
Senior High School. Because such improvements are already under way, it 
seems that the board, administration, and the community already have 
favorably responded to this need. A second problem area concerns the free 
time that is allotted to students under the New Design. Concern over 
student discipline, as well as the concern about the waste of the independent 
time, identifies a real problem area in the school system. As with the 
community, teachers recognize that many students are not assuming the 
responsibility that the great deal of independent study time gives them. 

A third problem area is suggested by the responses to Item 20 and 
to Items 1 and 11 under Part 4. These items suggest that teacher-pupil 
relations are not as good as the desired levels would recommend. For 
example, teachers do not seem to be readily available for pupil assistance 
and teachers do not seem to be seeing their students as much as they did 
under a more traditional plan. 

Several items suggest the need for greater teacher involvement in 
the decision-making process and a need to improve individualized instruc- 
tion opportunities, the curriculum, and the counseling services provided 
to the students. Teachers, as well as the community, expressed a need for 
better parent-teacher communication. This is an alarm area that is 
indicated by this questionnaire and by the School Survey. There seems to be 
a rather low impression of teacher -teacher relation. This will be 
discussed further in the following section. 

The many items that were rated "acceptable” suggest that the overall 
goals of the system and the Mew Design are being achieved. Typical of the 
responses to these questions are the achieving of the desired levels to the 
following three items. Eighty-seven percent of the teachers prefer modular 
scheduling to traditional scheduling, 92 percent of the teachers say they 
enjoy teaching in White Bear Lake Senior High School, and 82 percent of 
the teachers report they would recommend White Bear Lake High School to a 
friend. These items typify the large number of acceptable responses from 
the teacher questionnaire. 
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The next instrument to be discussed is the School Survey, an instrument 
developed at the Industrial Relations Center at the University of Chicago. 

The desired levels for the School Survey were set. at the norm for data 
available with the instrument. A summary of the findings in 14 different' 
categories is presented in Table 4. For each of these categories, a 
number of items were averaged together together to get the White Bear Lake 
responses and the norm responses. The bottom line of Table 4 is the norm 
percent favorable response while the top line ia the mean of 143 professional 
staff at White Bear Lake Senior High School. 

Strength areas, that is those categories where the response exceeds 

V It i •• 

the norm level by more than 10 percentage points, include the following: 
materials and equipment, special services, and voice in the overall 
educational program. "The materials and equipment category provides 
information on the respondents' opinions about the selection, quality, 
quantity, and use of instructional materials, aids, and equipment in the 
school." Special services, as defined in the School Survey manual, is to 
determine whether the school provides those services that are adequate to 
meet the varying needs of students. It deals both with the availability of 
programs and the interpersonal relations between teachers and special service 
personnel. A typical example is the item, "Our library services for students 
are very satisfactory." 

The category labeled "voice in educational program" is designed primarily 
to measure the teacher satisfaction with planning the school's educational 
program. It deals with curriculum development and choice of materials. A 
typical item is "the administration usually tries to take action on complaints 
from the faculty of this school." 

A further word of explanation is in order about the School Survey 
because the desired levels were determined by normative groups. The 
acceptable or desired levels are much lower than those of the previous 
questionnaires. For example, in the item just listed, the normative 
positive response is 55 per cent. The response for the White Bear Lake 
teachers was 64 percent, exceeding the desired level even though both the 
desired and the actual are lower than many of the questionnaire items. 



TABLE IV 

SCHOOL SURVEY - Summary P.ofilo 
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GROUP PROFILED: Professional Staff 

GROUP CODE NO.: White Bear Lake LEGEND: 

NO. IN GROUP: 141 


T 
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Because the School Survey is a trial tested and externally developed 
instrument, it is the recommendation of our evaluation group that the 
responses of this instrument be considered very carefully. We believe it 
detects some of the key problems and key strengths in the school 'System. 

Problem areas suggested by the professional staff response to the 
School Survey are listed below. Next to each category title la a sentence 
or two explaining what the category title means. For a complete listing 
of the items and the White Bear Lake response, the reader is referred to 
Appendix C . 

Problem Areas 

1. Administrative Practices 

This category measures the respondent's evaluation of the work 
of the administration in the school system. It includes both 
human relations and administrative aspects of the work at this 
level. It is designed to assess the more general aspects of 
the administrator -teacher relationship. 

2. Educational Effectiveness 

This category deals mainly with the effectiveness of the school 
in meeting the educational needs of t h^ coianun i ty . It attempts 
to determine whether the teachers feel that the school is 
fulfilling its community responsibilities. 

3. Evaluation of Students 

This category attempts to assess the respondent's attitude toward 
the process of evaluating and reporting student progress. It 
includes the general provision of teacher -student relationships 
primarily in the area of reporting student promotion, grading 
and the like. 

4. School -Community Relations 

This category reflects the teacher's understanding of the roles 
and responsibilities of the administration, school board, and 
community in operating the school system. It reports that the 
teachers do not consider existing relationships to be adequate 
to provide an effectively functioning school system. 
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5. Colleague Relations 

This category deals with the friendliness of people in the 
school and the interpersonal relationships among the various 
groups in the school. It is concerned both with the professional 
and social relationships. 

6. Building and Facilities 

This category assesses the physical working conditions within 
and immediately surrounding the school. It also measures the 
teacher* s feelings about the adequacy of the facilities and 
the administrative interest in maintaining and improving them. 

A further word of explanation is in order about the above categories. 
The average White Bear Lake teacher response is below the norm group 
approximately 15 to 20 percentage points. However, the norm group is a 
sample of 959 teachers in seven districts in Illinois, particularly in 
the Chicago area. When interpreting the above results, the nature of the 
norm group must be kept in mind. These readers interested in a precise 
definition of the items making up the categories of the School Survey are 
referred to the School Survey manual itself. 

The several categories where the objectives are rated acceptable 
include professional workload, supervisor relations, financial incentives, 
nonprofessional workload, and performance and development. Again the 
decision makers are reminded of the need to carefully examine the responses 
to individual items comprising the above categories. It is believed that 
this analysis will yield clues as to the source of the strength areas as 
well as the problem areas. 

STUDENTS 

The achievement of student objectives was assessed using the Student 
Questionnaire and the scores on the Iowa Test of Educational Development 
(ITED)* The Student Questionnaire was concerned primarily with determining 
students' attitudes while the ITED was used to determine variations in 
achievement levels. The attitudes of students will be discussed first. 
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TABLE V 

Summary of Student Questionnaires 



N = 293 Desired 

Favorable 

Response 


% 

Favorable 

Response 


Rating 


1. All students should have the opportunity to 
attend a school with modular scheduling. (A) 


75% 


88% 


Strength Area 


2. The senior high school has better teachers than 
other area high schools. (A) 


70% 


c4% 


Acceptable 


3. Students are given too much responsibility for 
their own learning. (D) 


50% 


76% 


Strength Area 


4. There are more discipline problems among our 
students than in other schools. (D) 


75% 


66% 


Acceptable 


5. The majority of our students are satisfied with 
the school. (A) 


90% 


74% 


Problem Area 


6. Most of our teachers care more for getting high 
salaries than for improving students' learning. (D) 


75% 


61% 


Problem Area 


7. The school facilities are inadequate for present 
needs as to size and design. (D) 


90% 


31% 


Problem Area 


8. Students are evaluated and graded fairly. (A) 


75% 


66% 


Acceptable 


9. The tax dollar is being well spent on the high 
school. (A) 


50% 


50% 


Acceptable 


10. The senior high school is providing quality 

education for the children of the community. (A) 


70% 


85% 


Strength Area 


11. Less independent study time should be given to 
students. (D) 


90% 


84% 


Acceptable 


12. Use of individual performance standards to judge 
student progress tends to lower the quality of 
work produced. (D) 


80% 


68% 


Problem Area 


13. Too many different courses are offered in the 
high school. (D) 


80% 


94% 


Strength Area 


14. More than half of their independent study time 
is wasted by students. (D) 


80% 


48% 


Problem Area 


15. Too much emphasis is placed on inter-scholastic 
athletics. (D) ' 


50% 


76% 


Strength Area 


16. Students can learn better in a regular class 
than through individualized instruction. (D) 


75% 


80% 


Acceptable 


17. Team teaching contributes to improved student 
learning. (A) 


60% 


70% 


Strength Area 


18. Students should be limited to a maximum of four 
courses at any one time. (D) 


60% 


88% 


Strength Area 


19. Listening to the teacher lecture is the best way 
for high school students to learn. (D) 


70% 


87% 


Strength Area 


20. Teachers are readily available to consult with 
individual students. (A) 


80% 


49% 


Problem Area 
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Desired 7. 







Favorable 


Favorable 








Response 


Response 


Rating 


21. 


Instructional secretaries, teacher aides, media 
specialists, and other supportive staff are too 
costly for the value they provide. (D) 


907. 


647. 


Problem Area 


22. 


The most useful component of modular scheduling 
is the small group. (A) 


507, 


807. 


Strength Area 


23. 


There should be no required courses in senior 










high school. 


(Information item; 


see appendix) 


• 

CNl 


I would recommend our high school to a friend. (A) 


807. 


857. 


Acceptable 


25. 


There is an adequate variety of extracurricular 
activities for students. (A) 


757. 


80% 


Acceptable 


Part 


II 








1 . 


Buildings and facilities 


807. 


597. 


Problem Area 


2. 


Job placement 


807. 


86% 


Acceptable 


3. 


Athletic program 


807. 


927. 


Strength Area 


4. 


Student control 


807. 


707. 


Problem Area 


5. 


School administration 


80% 


807. 


Acceptable 


6. 


Individualized instruction 


807. 


797. 


Acceptable 


7. 


Curriculum 


807. 


917. 


Strength Area 


8. 


Teachers' salary 


807. 


oo 

00 

O 

o'- 


Acceptable 


9. 


Career information 


807. 


787. 


Acceptable 


10. 


Extracurricular activities 


807. 


907. 


Strength Area 


11. 


Instruction 


807. 


887. 


Acceptable 


9 

CNI 


Resource materials 


807. 


807. 


Acceptable 


13. 


School board decision making 


807. 


737. 


Acceptable 


14. 


Personal counseling 


807. 


857. 


Acceptable 


15. 


Parent- teacher communication 


807. 


857.- 


Acceptable 




Desired 7. 

Part III Favorable Favorable 

Response Response Rating 



Useful 


757. 


5* 

-d- 

00 


Acceptable 


Expensive 


757. 


oo 

O 

5-9 


Acceptable 


Innova t ive 


757. 


5*3 

CNI 

H 


Problem 


Harmful 


75% 


92% 


Strength 


Dangerous 


75% 


93% 


Strength 


Effective 


75% 


66% 


Acceptable 


Impersonal 


75% 


897. 


Strength 


Old 


75% 


987. 


Strength 


Stimulating 


75% 


36% 


Problem 



itm 



Desired 7, 

Favorable Favorable 
Response Response Rating 



Unnecessary 


757. 


937. 


Strength 


Valuable 


757. 


587. 


Problem 


Rigid 


75% 


927. 


Strength 


Traditional 


75% 


987. 


Strength 


Poor 


75% 


937. 


Strength 


Individualizing 


757. 


57% 


Problem 


Adequate 


757. 


397. 


Problem 


Extravagant 


75% 


947. 


Strength 



/ 



i 
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1. 


Greater freedom of movement within the school 


Des ired 
Favorable 
Response 


7. 

Favorable 

Response 




has created a better learning environment. (A) 


757. 


737. 


2. 


Teachers are available for individual help. (A) 


757. 


567. 


3. 


There is no place in the school to go for 
self-study. (D) 


807. 


7 27. 


4. 


The N grade should be abolished. (d) 


7 57. 


667. 


5. 


There should be no required courses . (A) 


(Information item; 


6. 


I feel most of my teachers are interested 
in me as a person. (A) 


7 57. 


567. 


7. 


Certain departments have discouraged the 
taking of extra courses by students, (d) 


7 57. 


627. 


8. 


The curriculum has been individualized to 
meet my. needs. (A) 


507. 


617. 


9. 


I feel a counselor is helpful to me in 
working out my personal problems, (a) 


757. 


407. 


10. 


Most of my courses are very boring, (d) 


7 57. 


697. 


11. 


I am not personally involved in the activities 
of the school. (D) 


807. 


567. 


12. 


There is enough freedom in the course selection 
to meet the personal needs of the students. (A) 


7 57. 


777. 


13. 


The school administration is interested in 


t 




14. 


the students. (A) 


7 57. 


567. 


I have had a private conference this year with 
at least one of my teachers. (A) 


80% 


567. 


15. 


What percent of your class meetings do you skip 
on the average each week? 


9 07./ 907. 


9 07./ 9 07. 


16. 


What percent of your unscheduled time do you think 




17. 


xs wasted each week? 


807./S07. 


847./S07. 


In how many courses are you enrolled this semester? 40%/6 


407./ 6 


18. 


Are you involved in an independent study program 
for any of your courses? 


507. 


337. 


19. 


Have you ever visited a class in which you were 
not enrolled as a regular student? 


507. 


577. 


Part 


V 







Dull - Interesting 
Strict - Lenient 
Pleasant - Unpleasant 
Heaven - Hell 
Helpful - Harmful 
Good - Bad 
Weak - Strong 
Friendly - Cold 
Fun - Drudgery 
Easy - Hard 
Valuable - Worthless 
Exciting - Boring 
Rewarding - Punishment 
Zoo - Museum 



r" r- 



3.0 

3.0 

3.0 

3.0 

3.0 

3.0 

3.0 

3.0 

3.0 

3.0 

3.0 

3.0 

3.0 

3.0 



3.3 

3.0 

3.3 
2.8 
3.9 

3.8 

3.4 
3.3 
3.3 

3.1 

3.9 
3.0 

3.7 

2.4 



Rating 

Acceptable 
Problem Area 

Acceptable 
Acceptable 
see appendix) 

Problem Area 

Problem Area 

Strength Area 

Problem Area 
Acceptable 

Problem Area 

Acceptable 

Problem Area 

Problem Area 

Acceptable 

Acceptable 

Acceptable 

Problem Area 

Acceptable 



Acceptable 
Acceptable 
Acceptable 
Acceptable 
Strength Area 
Strength Area 
Acceptable 
Acceptable 
Acceptable 
Acceptable ' 
Strength Area 
Acceptable 
Strength Area 
Strength Area 
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Strength areas as far as students 1 attitudes are concerned were 
indicated when the responses exceeded the desired levels by more than 10 
percentage points. Similarly, problem areas were defined as those items 
that failed to reach the desired levels by more than 10 percentage points* 

We can summarize the strength areas by stating that the student's general 
impression of the school and the flexible modular program is good. On 
items concerning those two points, the students exceeded the desired levels. 
In addition, they accurately valued the components of the New Design; 
individualized instruction, variety of courses, the value of team teaching, 
the value of small groups, and the like. Similarly, they rated the athletic 
program as excellent as well as the extracurricular activity program. 

The students themselves see very little threat with flexible modular 
scheduling as judged by their responses to Part 3. 

In Part 5 we found the students likely to rate White Bear Lake Senior 
High School as helpful, good, valuable, and rewarding with none of the 
negative terms being the highest rated term for that criteria. 

Another strong area as judged by the students was the response to 
the item "students are given too much responsibility for their own learning." 
Only 24 percent of the students expressed agreement to that item, suggesting 
that they believe they are able to handle this responsibility. Later we 
will see that answers to ether items tend to conflict with this response. 

The identified problem areas according to students' responses can 
be seen by carefully examining Table 5. The major concern of students 
centers upon their perception of teachers and administrators caring about 
and being available for students. Items that suggest this characteristic 
are the fact that 39 percent of the students believe that teachers care 
more for getting higher salaries than for improving student learning, and 
only 49 percent of the students agreed that "teachers are readily available 
to consult with individual students." Desired levels were not achieved on 
items concerning the administrators' responses to students' needs and in 
the number of times that students had private conferences with teachers or 
with counselors. 

Students also perceived the need for improved facilities and 
questioned whether or not the learning aids in the form of teacher aides, 
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media specialists, and other supportive staff were being used effectively. 

In Part 3 of the questionnaire, the students tended to rate the system 
not as innovative, stimulating, valuable and adequate as the desired levels 
would suggest. They were also below the adequate levels in th<t response to 
the fact that some departments (36 percent) do discourage taking of extra 
courses and that 67 percent of the students reported they are not involved 
in any independent study whatsoever. 

One of the more interesting findings of the student responses when 
compared with the adult responses is their failure to perceive the problem 
in lack of responsibility for their free time* This is perhaps not too 
surprising considering the students are doing the rating yet it points out 
a conflict area between what students perceive ought to be the situation 
regarding their own responsibility and what teachers and the community 
perceive as the usefulness of their independent time. 

In the category labeled "acceptable" (the objectives are being 
achieved) a large number of items met these standards. Some typical 
responses are that 66 percent of the students felc they were evaluated 
and graded fairly while 69 percent of the students reported that their 
courses were not boring. A final consnent on the student responses concerns 
the semantic differential technique used in Part 5 where we note that 
students were more likely to rate White Bear Lake Senior High School as a 
zoo than as a museum. The meaning of this rating is not clear in the minds 
of the evaluators . 

ACHIEVEMENT RESULTS - IOWA TEST OF EDUCATIONAL DEVELOPMENT 

Of interest in an evaluation study is examining the effect a school's 
program has on the achievement of students proceeding through this program. 

For these purposes, the Iowa Tests of Educational Development (ITED) were 
administered to seniors and the results of these tests compared with their 
results in grades ten and eleven. This gives a rough estimate of achievement 
growth for a single class (Class of 1971) as it progresses through the program. 
Table 6 shows the results of these tests in composite scores on ITED. 
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TABLE VI 

Iowa Tests of Educational Development 
Summary of Composite Scores for the Class of 1971 



Class Enrollment - White Bear Lake 
N for Testing - White Bear Lake 
Mean Standard Score - National 
Mean Standard Score - White Bear Lake 
Student Norm % 

Projected Growth Scales on National Norms 
Growth Scales - White Bear Lake 



Grade 10 


Grade 11 


Grade 12 


718 


701 


723 


664 


586 


554 


16.4 


18.5 


19.6 


16.8 


19.4 


20.6 


68 


69 


72 


518.0 


540 


555 


518.0 


548.9 


562.5 



Although the class enrollment remained fairly constant, the number 
actually being tested (N) dropped markedly. It cannot be safely assumed 
that the 169 seniors not tested as seniors (23.4%) are a representative 
sample of all seniors. 

Using the data on students tested, White Bear Lake Seniors rank at 
the seventy-second percentile on national norms. Growth rates reflected 
in the rise in percentile rank and the growth scales show slight gains 
from grade 10 to grade 12. Because nearly one-fourth of the seniors were 
not present for testing, it seems safe only to conclude that the growth 
rate through the senior .high school program of the present White Bear 
Lake Seniors does not differ significantly from the typical group of 
seniors nationally. 
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GRADUATES 

In cooperation with TIES (Total Information for Educational Systems), 
the responses to several selected items from students graduating three 
years ago and five years ago are reported in this section. The character- 
istics of the graduates over the past five years are presented in Table 7. 

The purpose of this table is to present what the graduates of White Bear 
Lake Senior High School are likely to be doing during the five years following 
graduation. It is interesting to note that 67 percent of last year's 
graduates are now students and also to note how that number decreases with 
time, particularly after 1967. We also noticed that g 

who find themselves in the military or who become housewives gradually 
increases as time progresses. 



TABLE VII 

Characteristics of Graduates 



If given your choice, would 
you elect to send your children 


1970 


1969 


1968 


1967 


1966 


to White Bear Lake Senior High 
School? (Yes) 


70% 


71% 


76% 


67% 


75% 


Number of Respondents 


230 


260 


185 


122 


147 




1970 


1969 


1968 


1967 


1966 


Unemployed 


6 


4 


5 


2 


4 


Working 


20 


25 


26 


26 


39 


Student 


67 


61 


46 


40 


16 


Current status 

of graduates Military 


4 


5 


8 


10 


12 


Housewife 


1 


5 


14 


20 


27 


Other 


3 


- 


1 


1 


2 



(Percentages) 
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The TIES questionnaire was designed independently of the evaluation 
study; however, several items were thought to measure the objectives 
developed by the evaluation committee of the school and the evaluation 
staff at ERDC. These items measure objectives and are reported in Table 8. 

Selected items from the TIES questionnaire for graduates of three years 
ago and graduates of five years ago are shown. In general the graduate 
responses indicate that the objectives established by the school are being 
achieved. Only in Item 7 do the graduates of both years fail to reach the 
desired levels. This item concerns the opportunity for informal personal 
discussion with half the teachers and the number responding was not quite 
to the desired level established. However, the responses to the remainder 
of the items suggest that graduates from White Bear Lake Senior High School 
leave the school with a feeling that they have received an education that 
is adequately preparing them for their future life. We think the responses 
to the item "if given your choice, would you send your children to White 
Bear Lake Senior High School" typify quite well the general positive 
feelings possessed by these graduates. 
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TABLE VIII 

Summary of Selected Responses for 1968 and 1966 Graduates 





N (1968) - 185 




Desired 


% 






N (1966) - 143 


Favorable 


Favorable 






• 




Response 


Response 


Rating 


1 . 


If after graduating from high school 
you entered Into a vocational, trade, 
or business school, how satisfied were 
you with the benefits derived from 
Industrial arts, vocational education, 
business education, and/or home 
economics at White Bear Lake High 


1968 


70% 


74% 


Acceptable 




School? (Satisfied) 


1966 


70% 


86% 


Strength Area 


2. 


As a college or college-bound student, 
do you feel you were well prepared for 


1968 


75% 


73% 


Acceptable 




college? (Yes) 


1966 


75% 


64% 


Problem Area 


3. 


If given your choice, would you elect 
to send your children to White Bear 


1968 


70% 


76% 


Acceptable 




Senior High School? (Yes) 


1966 


70% 


75% 


Acceptable 


4. 


Did White Bear Senior High School 
provide a vehicle for social involvement 


1968 


80% 


75% 


Acceptable 




and growth? (Yes) 


1966 


80% 


66% 


Problem Area 


5. 


Did you have an informal personal 
discussion with more than half of your 
teachers at White Bear Senior High 


1968 


90% 


77% 


Problem Area 




School? (Yes) 


1966 


90% 


76% 


Problem Area 


6. 


Were the communication skills obtained at 
White Bear Senior High School adequate for 


1968 


90% 


95% 


Acceptable 




daily living? (Yes) 


1966 


90% 


96% 


Acceptable 


7. 


Did your high school experiences enable you 


1968 


85% 


90% 


Acceptable 




to develop self-discipline? (Yes) 


1966 


85% 


91% 


Acceptable 
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ON-SITE OBSERVATIONS AND INTERVIEWS 

Following are overviews of the impressions of several visits to 
the White Bear Lake Senior High School during January, February, and 
March. The data that follows is subjective in nature and reflects the 
opinions and interpretations of the on-site observers and interviewers: 

1. The overwhelming opinion of students and staff regarding the 
"New Design" is very positive. Neither group would prefer a 
traditional scheduling pattern. 

2. Many of the problems identified in this report are related to 
the lack of space and facilities. 

a) Many students anticipating work on assignments find no 
available space in resource centers and leave to visit 
with their friends in the halls and cafeteria area. 

b) The library is often overcrowded during times when the 
entire cafeteria area is unavailable for student use 
due to the heavy lunch schedule. 

c) There is no area available for small groups of students 

to discuss assignments. They must either work independently 
in resource centers and the library or be exposed to the 
often noisy environment of the cafeteria area. 

d) Students all mentioned the lack of space and time to eat 
their lunch. 

3. The students interviewed indicated they used their independent 
study time wisely, but that a large portion (30-50 percent) of 
the student body did not. (There seems to be improvement as one 
progressed through the program, i.e., seniors had learned to use 
their time more wisely than they did as sophomores.) Even while 
using the resource centers some students indicated there was 
nothing to do, and at times they could not find needed materials 
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in some centers * 
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4. A significant number of students indicated they had difficulty 
meeting with teachers during independent study time or that 
they did not choose to meet with teachers. Some teachers 
often make appointments with students during free mods, others 
do not. ' Regardless of the source of responsibility for student- 
teacher conferences, a large number of students are not meeting 
individually with their teachers. 

5. The Core students were generally very pleased with their curriculum 
and instruction. The program is moving in a positive direction in 
meeting the curricular and instructional needs of the students. 

The staff is dedicated and is generally interested in the student 
and relates well to him. The physical facilities are inadequate 

as to design. For example, Core students may elect science as a 
Core subject, yet laboratory use seems almost nonexistent. 

Provision also should be made to allow for subdivision of the 
large room into smaller instructional areas when desired. There 
is also a public relations problem both within and without the 
school. The Core students perceive that non -Core teachers and 
community people "look down on them" . In interviews with some 
non -Core teachers and community residents, a negative attitude 
toward Core was evident. 
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CONCLUSION 



The purpose of an evaluation study is to collect data useful in the 
decision~making process. It is not the intent of this report to make 
recommendations. That task properly falls under the domain of the decision 

e 

maker. The data summarized in the foregoing section is presented in a form 
intended to be of greatest value to those responsible for decisions regarding 
continuation and/or modifications of the various components of the school 
program . 

The decision makers at all levels within the School district should 
critically analyze the data, set priorities on problem areas, examine 
alternative strategies for change, and make recommendations. During the 
implements t ion of any recommended change, evaluative procedures should be 
utilized to determine the extent to which the desired change is being 
achieved. This calls for implementation or process evaluation as well as 
a final or product evaluation. 

If the continued use of this evaluation model is desirable in the 
future, those responsible for the evaluation study should periodically 
review and modify objectives and criterion levels to be consistent 
with current professional judgement. 

The tables in the previous section represent only a portion of the 
wealth of data collected and available to decision makers. By careful 
examination of the instruments and responses in the appendix, one can gain 
access to additional information. The scope and usefulness of this report 
requires that much of the detailed and complex data be simplified and/or 
deleted. This detailed information has been recorded and is available on 
data keypunch cards and computer printouts and, if desired, can be 
gleaned from these sources. This data includes breakdown by sex, professional 
levels, parent -nonpa rent , age, and other characteristics of referent 
groups in addition to a more detailed breakdown of the dependent variables 
or responses . 



The data collected and reported here meets and goes beyond the efforts 
and expectations originally proposed. We believe educators responsible for 
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the White Bear Lake Senior High School program will find it to be a 
valuable tool in the process of continuing, strengthening and/or 
modifying aspects of their program. 

After careful examination of this report priorities and 
recommendations shpuld be determined, and the design and implementation 
of changes should, with evaluation procedures, commence as soon as possible. 
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APPENDIX A 

Reprint of "A Performance Based Model for Program Evaluation" 
APPENDIX B 

Summary of Evaluation Workshop 



APPENDIX C 

Community Questionnaire (Gold) 

Community Interview (Yellow) 

Teacher Questionnaire (Blue) 

School Survey (Yellow) 

Student Questionnaire (Green) 

Total Information for Educational Systems (TIES) (white) 



NOTE: 


1. Rating code for instruments 






S = Strength Area 
A = Acceptable 
P = Problem Area , 






2. The symbol "*•" before a percentage means 
The symbol "+" before a percentage means 


"less than", 
"more than" . 
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DEPARTMENT OF EDUCATIONAL ADMINISTRATION 
COLLEGE OF EDUCATION 
UNIVERSITY OF MINNESOTA 



Fall, 1970 
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Number I 



“ The performance based evaluation model gives administra- 
tors a tool by which the success of programs can be deter- 
mined in order to make sound decisions about their 
continuation and improvement. ” 



A Performance Based Model 

for Program Evaluation 



Introduction 

The influx of federal money into education during the 
decade of the sixties resulted in the development of thou- 
sands of new programs. The goal of most of these new pro- 
grams was departure from the traditional ways of educating 
our youth. Much time and effort was spent in designing new 
and, hopefully, improved means for attacking educational 
problems. However, the closing of the decade brought with it 
a reduction in federal spending, and pressure was exerted to 
initiate evaluation programs that would give some indication 
which of the many programs were successful. Unfortunately, 
the time and support available for evaluation planning and 
implementation was minimal, and little was available to guide 
program developers in setting up useful evaluation designs. As 
a result, there was considerable pressure for evaluation, but 
little available in the way of strategy to conduct these evalua- 
tions. This paper is a description of one attempt to add to the 
storehouse of available evaluation models. 

Evaluation is the gathering of information to give deci- 
sion makers data essential for sound, effective decisions. The 
usual reasons for these decisions are for program improve- 
ment (formative or process evaluation), program information 
(summative or product evaluation), or for reinforcement of 
those human efforts put forth in the program development 
(supportive evaluation).' The last is quite frequently the pur- 
pose for evaluative efforts even though it has little effect on 
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subsequent decision making. An additional and often over- 
riding reason lies in what has become known as “account- 
ability”. No longer is there enough money to fund every 
proposed program. Decision makers must answer these ques- 
tions to community and federal fund sources: “What evi- 
dence is there that the program achieves its objectives?” “Is it 
worth the cost?” Providing data to help answer these and 
other similar questions has become the primary focus of 
evaluation efforts. 

In addition to determining the reasons for conducting an 
evaluation study, the evaluator must obtain answers to the 
question, “What is being evaluated?” Specifically answering 
this question causes school people frustration and many 
agonizing moments. Yet, it is essential to clearly com- 
municate the objectives of the program to the evaluator to 
enable him to know exactly what is to be evaluated. 

Model Conception 

The decade of the 60 ’s was the decade of change and 
innovation in the public schools — modular flexible sched- 
ules, differentiated staffing, team teaching, performance 
curriculum, independent study, non-gradedness, and many 
others. Schools involved in these and other innovations are 
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under pressure from funding agencies and their local con- 
stituency to provide evidence that new programs are worth- 
while. More and more, these schools are turning to outside 
agencies to evaluate their new programs. In response to these 
requests, a performance-based evaluation model was de- 
veloped by the authors* * and is currently Wing implemented 
in a St. Paul suburban high school, White Bear Lake. 

Ideally an evaluation design should include some type of 
comparative data. This could be either the use of a control 
group or a comparison of pre and post test date. In many real 
situations, however, base line data are not available, and com- 
parable schools either do not exist or are not readily acces- 
sible. It is desirable that some other strategy is available. A 
method must be designed to evaluate the program by pre- 
cisely determining if the goals of a new program have been 
met. Such is the purpose of the performance based evaluation 
model described below. 

The proposed strategy is to formulate as specifically as 
possible objectives that would measure the goals originally 
stated as the objectives of the program to be evaluated. The 
degree to which the objectives are achieved would be an 
indication of the success of this new program and would 
indicate components of the program needing modification 
and improvement. The testing of this model in the White 
Bear Lake Senior High School evaluation situation would 
allow for its refinement and subsequent use on a wider base. 

Model Formulation 

What is being evaluated? In this sample case, it is a pro- 
gram based on a coordination of the concepts and models of 
Trump and Allen. 1 The White Bear Lake Senior High School 
moved to a new design in secondary education in the fall of 
1967. As stated in the report of their internal evaluation, 5 



•The model herein described was developed by Wayne W. Welch as a 
project of the Educational Research and Development Council of the 
Twin Cities Metropolitan Area and is currently being tested by Dwight 
Lindbloom and Maureen Flahaven in the White Bear Lake Senior High 
School. 

* For such concepts and models see Bush, R.N. and Allen, Dwight, A 
New Design for High School Education, McGraw-Hill Book Co., New 
York, N.Y., 1964, and/or 

Trump, J. Lloyd and Boynham, Dorsey, Guide to Better Schools: 
Focus on Change, Rand McNally and Company, Chicago, 1961. 

! * Evaluation of White Bear Lake Senior High School instructional 
Design, 1968-69, White Bear Lake Senior High School, White Bear 
Lake, Minnesota, 1969, (mimeo). 
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the following are the five objectives of their "New Design": 

1. To individualize instruction by focusing on the indi- 
vidual student through the use of performance 
curriculum. 

2. To offer an expanded program to students by per- 
mitting and encouraging them to enroll in additional 
courses for credit or noncredit. 

3. Better staff utilization through the team approach 
and use of teacher assistants, teaching interns, 
teacher aids, instructional secretaries, material 
specialists, and a comprehensive inservice education 
program. 

4. To make change possible as the need arises through 
the use of flexible modular scheduling. 

5. To teach students to become more responsible for . 
their own learning through the use of independent 
study. 

Why evaluate? The purpose of this evaluation is to give 
feedback as to the success of the program in achieving its 
goals. But more important, the information from this study 
will be used to make decisions regarding the improvement of 
the ongoing program. 

Using the five objectives stated above as a base, specific 
operational or performance objectives were formulated with 
given criterion levels. Only in this way could the degree of 
objective achievement be assessed. Identification of specific 
objectives and criterion levels demands input from profes- 
sionals with a good knowledge of the program evaluated. 
Therefore, the translation of the overall objectives into opera- 
tional terms required a coordinated effort of the evaluation 
team and the program staff most closely involved in the 
design and implementation of the new program. Referent 
groups — students, graduates, staff, and community -• were 
identified, and sets of objectives regarding these groups as 
well as overall specific objectives were formulated during a 
three day workshop. A total of 163 objectives and acceptable 
performance levels were developed to serve as the guideline 
for the evaluation. 

A specific objective for students was, "At least 75% of 
the students will attend and work in open labs, resource 
centers, and/or the library at least 85% of their unscheduled 
time." Another typical objective for teachers was, "At least 
85% of the teachers are developing and utilizing written 
behavioral objectives." Agreement on objectives as well as 



tentative consensus regarding criterion levels was accom- 
plished by the action of the total evaluation committee. 

Model Refinement 

With several sets of objectives in hand the evaluation 
team set out to eliminate duplicates, consolidate overlap, and 
clarify and refine all objectives formulated at the initial work- 
shop. Using these refined objectives as a base for measure- 
ment, instruments and techniques were selected and de- 
veloped for gathering data. Review of the instruments, agree- 
ment on the specific refined objectives, and consensus on the 
criterion levels were accomplished with the aid of the evalua- 
tion team in a day’s workshop with program staff of the 
school system. 

The development and selection of the instruments 
resulted in the following data gathering devices: 

1. Questionnaires for all students, teachers, and 300 
randomly selected community residents. All three 
questionnaires contain a common core of 25 ques- 
tions plus individual components for each specific 
referent group. 

2. A community questionnaire to be used through a 
personal interview technique ff>r 50 parents and 50 
non-parents randomly selected. 

3. The Iowa Test of Educational Development for all 
students. 

4. The School Survey, a standardized 120 item inven- 
tory for all teachers covering opinions and attitudes 
about their work. 

5. A questionnaire for all graduates of the past five 
years including questions to measure specific White 
Bear Lake objectives. 

In addition to the instruments mentioned above, struc- 
tured observational techniques will be used in the classroom 
and school environment to supplement the data obtained 
through this instrumentation. 

Model Testing 

Data will be gathered during a three-month period. The 
community interviews will be conducted by four professional 
educators with training in interview techniques. The paper 
and pencil tests, questionnaires, and inventories will be 
administered by school personnel. All data collected will be 
statistically summarized and matched with the specific objec* 
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tives and related criterion levels. For example one objective 
states: "80% of students and teachers agree that performance 
standards or criterion measures provided in the performance 
curriculum are a strong incentive for students to do their best 
work.” On the common core of test items for teachers and 
students, the respondent must agree or disagree with the 
statement: "Use of individual performance standards to judge 
student progress tends to lower the quality of work pro- 
duced.” In cases where criterion levels have been met and/or 
surpassed, (in the above example, 80%), the program objec- 
tive will be considered met and the program a success at 
those points. If, however, the criterion levels have not been 
met, the evaluation committee will make specific recommen- 
dations for program improvement. If, for example, the data 
show that the community is not well informed on program 
changes, the recommendation may be to provide fiscal and 
human resources to strengthen the public relations program 
of the school. If it is determined that teachers behave simi- 
larly in small and large groups, this has implications for ’ 
recommending inservice education in group dynamics. The 
decision makers at the secondary level will then have the data 
and alternative recommendations available to make decisions 
regarding the implementation of program improvement. 

Model Generalization (Application) 

It is difficult to make recommendations about the model 
in a generalized sense until its final testing at White Bear 
Lake. However, the model proposed by the writers has many 
possibilities (as well as problems) for program evaluation. Its 
major asset is that it can be used in a variety of settings and 
for a multitude of unique programs. It can also be combined 
with a statistical comparison approach when control groups 
are available. This performance based design can be used as a 
model for an internal evaluation where the use of control 
groups is extremely difficult. It is important that educators 
with knowledge of the program also be skilled in stating 
objectives behaviorally and work closely with the evaluation 
team in setting performance goals. 

Weaknesses of this design stem to a large degree from its 
early stage of development and lack of refinement. Some of 
the problems are : 

(1) Translation of the general objectives into specific 
performance terms. Although these objectives are specific 
and not subjective in nature, they are formulated by the 
subjective value judgments of the professionals. • 



•j 



67 



(2) Determination of the criterion levels. These are also 
based on value judgments and therefore subjected to the po- 
tential unreliability of professional opinion. A distinction 
must be continually made between “what do we want” and 
“what do we expect”. 

(3) Selection, development, and validation *of appropri- 
ate instruments and techniques for data collection that are 
relevant to the objectives. 

This evaluative design shares the problems inherent in any 
evaluation in that it is situation-oriented. It is complex and 
difficult to define; the data collected are determined by feasi- 
bility and reflect the value judgments of decision makers; 
and, there is a lack of precise variable control. Because of the 
nature of evaluation, these studies will never obtain the preci* 
sion and control of research studies. However, evaluation is 
now in its infancy in scientific development, and hopefully 
some of the problems will be resolved with the growth and 
refinement of its techniques. 

It is the opinion of the writers that this performance- 
based model is applicable to a wide range of situations. 
Administrators and other decision makers will find in it a 
tool by which pertinent information can be. collected and 
summarized regarding the success of programs in order to 
make sound decisions about their continuation and/or 
improvement. 
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SUMMARY OF EVALUATION WORKSHOP 
WHITE BEAR LAKE SENIOR HIGH SCHOOL 



In partial fulfillment of its agreement to conduct an evaluative study 
of the White Bear Lake Senior High School, an evaluation team from the staff 
of the Educational Research and Development Council of the Twin Cities Metro- 
politan Area (ERDC) met with the evaluation committee of the White Bear Lake 
Senior High School in a three-day workshop, June 8, 9, and 10, 1970. 

The purpose of this workshop was to initiate strategies by identifying 
and formulating behavioral objectives for the new educational program in the 
high school. 

The participants and objective formulators present included the following: 

ERDC Staff: 

Dr. Wayne Welch, Director of Research 
Dwight Lindbloom, Research Assistant 
Maureen Flahaven, Research Secretary 

Evaluation Committee, White Bear Lake Senior High School: 

Dr. Fred Rohde, Assistant Superintendent, Secondary Education 

Paul Brynell, Counseling 

Larry Cozad, Principal - Curriculum 

William Fredell, Media 

William Murray, Physical Education 

Edward Holtz, Industrial Arts 

Clarence Barta, Science 

Ron Johnstone, Vocational Education 

Joseph Tamillo, English 

Al Hibbard, Foreign Language 

The specific objectives of this workshop were: 

1. To write a set of overall school behavioral objectives to 
serve as a basis for gathering evaluation data during the 
fall, 1970. 

2. To state behaviorally , school goals regarding students, 
teachers, community, graduates, and other identifiable 
referent groups. 

3. To select and/or develop specific instruments and techniques 
for gathering data to determine if objectives are being 
achieved. 

The following procedure was followed to meet the objectives 
stated above: 

1. The members of the evaluation team from ERDC and White Bear 
Lake High School were introduced. 

2. The purpose of the evaluation, the proposed procedure (based 
on behaviorally stated objectives) , possible forms of instru- 
mentation, and possible forms of the outcome were explained 
and discussed. 



3. Members of the White Bear Lake Evaluation Committee discussed 
the philosophy, concepts, implementation and operation of the 
New Design in White Bear Lake Senior High School. 

4. To introduce all members to behavioralizing objectives on a 
school-wide basis, a general "warm-up" session was conducted 
in which members agreed on the form of these objectives, 

5. The total group was subdivided into four groups representing 
students, .graduates, faculty, and community, in order to for- 
mulate behavioral objectives in these specific areas. 

6. The total group met to review a few of the objectives from 
each subgroup in order to gain consensus on the behavioral 
nature of the objective and its criterion level. 

7. Subgroups met again to review, alter, clarify, and add to the 
objectives for their representative group. 

8. The objectives for each group were totally reviewed and revised 
with agreement as to criterion levels by the total evaluation 
group. 

9. New subgroups were formed to construct objectives for the 
overall school program geared specifically to the components 
of the New Design. 

10. Again, review, revision, and clarification of these objectives 
was accomplished with agreement on specific criterion standards 
for each objective by the entire group. 

11. All of the objectives were given to the staff of ERDC for 
refinement and instrument selection. 

12. A review of procedure, related instrumentation, and projection 
for further total group involvement concluded the three-day 
workshop. 

Summary and Evaluation 

All the objectives stated above were accomplished. The ERDC evaluation 
staff found the White Bear Lake Evaluation Committee cooperative, congenial, 
and extremely competent in the formulation of behavioral objectives. All 
members of the evaluation committee participating in the workshop exhibited 
patience in explaining the intricate workings and components of the New 
Design, giving the ERDC personnel the needed framework within which the 
evaluation can successfully be conducted. 

It was a wise decision to conduct a three-day rather than a five-day 
initial workshop, thereby reserving two days for later review, revision 
and evaluation. 

It is essential to work with the members of the evaluation committee 
in the development of questionnaires and instruments designed to measure 
the objectives formulated at the workshop. 
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SENIOR HIGH SCHOOL QUESTIONNAIRE 




This Instrument Is the property of the Educational Research and Development Council 
of the Twin Cities Metropolitan Area, Inc., 211 Burton Hall, University of Minnesota, 
Minneapolis, Minnesota. It was developed In collaboration with the White Bear Lake 
Senior High School Evaluation Committee. Copyright © 1970, Wayne W. Welch. 
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SENIOR HIGH SCHOOL QUESTIONNAIRE 



Number of Respondents « 142 
Parent of High School Student: Yes No 



Below are listed a number of statements about your senior high 
school, its students, and teachers. Please circle the appropriate 
letters that describe how you leel about the statement. Circle: 



DD if you strongly disagree with the statement. 
D if you disagree mildly with the statement. 

A if you agree mildly with the statement. 

AA if you strongly agree with the statement. 



Desired 

Level 


7 Agree 


n 

6 

o 


+ 507, 


42%, 


A 1. 


+ 50% 


53% 


A 2. 


- 50% 


61% 


P 3 * 


-25% 


24% 


A 4. 


+ 90% 


62% 


P 5- 


-25% 


43% 


p 6. 


-10% 


51% 


P 7. 


+75% 


7 6% 


A 



Thank you for helping us in this evaluation. 



I. 

All students should have the opportunity to attend a school with 
modular scheduling- DD D 

The senior high school has better teachers than other area high 
schools* DD D 

Students are given too much responsibility for their own learning. DD D 

There are more discipline problems among our students than in 

other schools. DD D 

The majority of our students are satisfied with the school- DD D 

Most of our teachers care more for getting high salaries than for 
improving students' learning- DD D 

The school facilities are inadequate for present needs as to size 

and design. DD D 

Students are evaluated and graded fairly- dd D 



& 



A AA 

A AA 
A AA 

A AA 
A AA 

A AA 

A AA 
A AA 



2 . 
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+ 507. 


537. 


A 


9. 


The tax dollar is being well spent on the high school. 


DD 


D 


A 


AA 


+ 507. 


787. 


S 


10. 


The senior high school is providing quality education for the 
children of the community. 


DD 


D 


A 


AA 


-107. 


607. 


P 


11. 


Less independent study time should be given to students. 


DD 


D 


A 


AA 


-207. 


377. 


P 


12. 


Use of individual performance standarda to Judge student progreas 
tends to lower the quality of work produced. 


DD 


D 


A 


AA 


-257. 


147. 


S 


13. 


Too many different coursea are offered in the high school. 


DD 


D 


A 


AA 


-207. 


717. 


P 


14. 


More than half of their. independent study time is wasted by 
students . 


DD 


D 


A 


AA 


-507. 


297. 


s 


15. 


Too much emphasis is placed on inter -scholas tic athletics. 


DD 


D 


A 


AA 


-507. 


327. 


s 


16. 


Students can learn better in a regular class than through 
individualized ins true t ion . 


DD 


D 


A 


AA 


+ 607. 


687. 


A 


17. 


Team teaching contributes to improved atudent learning. 


DD 


D 


A 


AA 


-407. 


177. 


S 


18. 


Students should be limited to a maximum of four courses at any 
one time. 


DD 


D 


A 


AA 


-507. 


147. 


s 


19. 


Listening to the teacher lecture is the best way for high achool 
students to learn. 


DD 


D 


A 


AA 


+807. 


377. 


p 


20. 


Teachers are readily available to consult with individual students 


. DD 


D 


A 


AA 


-107. 


407. 


p 


21. 


Instructional secretaries, teacher aides, media specialiats, and 
other supportive staff are too costly for the value they provide. 


DD 


D 


A 


AA 


+ 507. 


847. 


s 


22. 


The most useful component of modular scheduling i6 the small 
group. 


DD 


D 


A 


AA 




67. 




23. 


There should be no required courses in senior high school. 


DD 


D 


A 


AA 


+807. 


7 57 t 


A 


24. 


I would recommend our high school to a friend . 


DD 


D 


A 


AA 


+757. 


887. 


S 


25. 


There is an adequate variety of extracurricular activities for 
students . 


DD 


D 


A 


AA 



PLEASE TURN THE PAGE 
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In the spaces below, mark with a (v') any areas where you think real improvement 
is needed in the senior high school. 



1 

ro 

O 

cS? 


25% 


A 




buildings and facilities 


-207; 


20% 


A 




Job placement 


0 

CM 

1 


6% 


S 




athletic program 


0 

CM 

1 


46% 


p 




student control 


0 

CM 

1 


25% 


A 




school administration 


-20% 


39% 


P 




individualized instruction 


-20% 


11% 


A 




curriculum 


0 

CM 

1 


9% 


S 




teachers' salary 


0 

CM 

1 


32% 


P 




career information 


0 

CM 

1 


6% 


S 




extracurricular activities 


-20% 


22% 


A 




instruction 


-20% 


12% 


A 




resource materials 


-20% 


27% 


A 




school board decision making 


-20% 


34% 


P 




personal counseling 


-20% 


5^ 

OC 


P 




parent -teacher communication 


-20% 


7% 


S 




none that are obvious 


0 

CM 

1 


15% 


A 




others (list them) 
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III. 

Mark with a (vO those words that in your opinion describe the flexible modular 
scheduling program being used in the senior high school. Check all words you 
think are applicable. 



+ 75% 


y/% 


p 


use ful 


-25% 


29% 


A 


expens i ve 


+75% 


34% 


p 


innovative 


-25% 


30% 


A 


harmful 


-25% 


18% 


A 


dangerous 


+75% 


28% 


P 


effect ive 


-25% 


34% 


A 


impersona 1 


-25% 


0 


S 


o Id 


+75% 


5^* 

CM 

O'* 


P 


s t imulat ing 



-25% 


29% 


A 


unnecessary 


+ 7 5% 


29% 


P 


va luab le 


-25% 


2% 


s 


rigid 


-25% 


0 


S 


trad i t iona 1 


-25% 


34% 


A 


poor 


+75% 


33% 


P 


individualizing 


+7 5% 


19% 


P 


adequa le 








extravagant 


-25% 


17% 


A 
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APPENDIX C 



J 

WHITE BEAR LAKE 

COMMUNITY INTERVIEW QUESTIONNAIRE 
Number of respondents ■ 94 

Hello, l'm « from the Educational Research and 

Development Council of the Twin Cities, and we are doing a study and evaluation 
of the new program In the Senior High School* I believe you received a letter 
of Introduction stating we are Interested In your opinions concerning the new 
program* 



1* Have you had children attending White Bear Lake Senior High School? 
Yes No 



If Yes, when 
Grade 



> 


0) 


Sex 


0) 




hJ 


o 




*u 


o 


0) 


0) 


60 


0) 


u 


c 


u 




•H 


60 


CO 


4J 


< 


o> 


CO 




Q 


OS 


5^ 



If No, any future attendance 

What school presently attending? 



2* What type of program does White Bear Lake Senior High School have? 



1%, Traditional 

+75% S 94% Flexible Modular 
Contract Method 



Non -graded 

(5% Don't Know) 




+75% 

+75% 

- 25 % 

+75% 

+75% 

+75% 

+75% 

+75% 



3* Some suburban schools have added various components to their school program; 
to your knowledge does White Bear Lake Senior High School have any of the 
following: 

S 87% A work-release program 

p 61% More than one teacher for a single course 

% 

A 33% Open campus (students able to leave school grounds when not in class) 

P 33% Possibility to complete high school in two years 

P 44% A grading system with no failures 

P 63% Rating of students based on Individual merit rather than group comparison 

A 78% A planned program for parents to visit the school 

A 82% Specialty designed smell group instruction for all students 

. 



Desired 

Level 


Rating 

Code 

• 


01 

0) 

5 ^ U 

00 

Havl 


you ever done any of the following: 


+35% 


A 


31% 


Participated in a visitation program at the school 


+35% 


P 


11 % 


Attended a school board meeting 


+35% 


A 


42% 


Talked to a teacher regarding the program 


+35% 


S 


51% 


Attended PTA, Citizens for Better Education or other education meetings 



(Underscore which) 



5. Under the high school's new program, do you think the rate of the following 
has increased, stayed the same or decreased? 



Daily Attendance: 


277. Increased 


357. stayed the same 


31% Decreased 


Dropouts : 


347. increased 


32%, stayed the same 


267. Decreased 


Non -graduates : 


33% Increased 


35% stayed the same 


217. Decreased 


Achievement : 


_f[3% increased 


21 % Stayed the same 


24% Decreased 


Student Interest: 


427. Increased 


277. Stayed the same 


30% Decreased 



r 

6. In general, do you prefer the new design or the traditional program? ^ 



+60% P New 46% Old 

Most Like: 35 % made no comment. 

1. 227, - Students can achieve more by themselves; individualized 

2. 14% - The program is good for bright students. 

Least Like: 3. 14% - There's a good variety of courses. 

22 % made no comment . 

1. 24% - There is a lack of discipline or control. 

2. 177. - There is too much free time. 

3. 16% - The program is poor for the average or slower student. 

7. In general, do the students like or dislike the high school program? 

+60% A Like 67% Dislike 24% 

Most Like: 




Least Like: 
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In general, how do you think White Bear Lake Senior High School compares 
with other euburban echools? That Is, la White Bear: 



+60% A 66% Above Average 
26% Average 



1% Below Average 



9. Would you say White Bear Lake Senior High School la, or Is not, providing 
students with the background for success In college or other post high 
school training? 

+60% S Is 84% Is Not 



10. Would you say White Bear Lake Senior High School Is, or Is not, providing 
saleable skills for Job entry for students who desire them? 

+60% S Is 77% is Not 



+75% 



11* What Is your opinion of the extra-curricular activities (including drsma, 
music and the arts, athletics, and debate) at White Bear Lake Senior High? 
That is, would you say the program Is: 




More than sufficient 
Sufficient 

Insufficient to meet the needs 
Don't Know) 



(Too much? 

(Which areas? 



and Interests of the students 



.) 

.) 



12. How much Independent study time (that time when students are not In assigned 
classes) should senior high school students have: 

6% All of his time 



11% Most of his time 
+60% A 55% Some of his time 



22% Very little of his time 



TD 

0) 

U 



0) 
> 
(0 0) 
0) 1-3 
Q 




•H 0) 



4J T3 
(0 O 
DC O 



0) 

0) 




How much freedom does the student have under the new design? 
56°/, Too much 



+60% P 31% About right 



3% Too little 



14. Under the new design, is control of students or discipline: 
1% Too strict 

+60% P 47% About right 

44% Too permissive 



O 

KLC 



15 • Should restrictions be placed on White Bear Lake Senior High School 
students regarding dress and appearance? 

Yes No 32y o 

If Yes , what kind of restrictions? 108 restrictions were offered 

1* 38 asked for general or overall restrictions. 

2. 30 wanted restrictions on long hair on boys. 

3. 15 wanted to ban jeans, shorts and slacks on girls. 

16. Should the school be involved in discussing current and controversial 
issues, such a6: 



Drugs : 


Yes 


99% 


No 


Birth Control: 


Yes 


87% 


No 


Gun Control: 


Yes 


92% 


No 


Sex Education: 


Yes 


94% 


No 

i 

t 


Draft Information: 


Yes 


95% 


No 


U. S. Involvement in War: 


Yes 


95% 


No | 


Civil Rights: 
Other: 


Yes 


6 s ** 

CO 

<* 


No 

I 


How do you think students would 


respond 


to the above? 


Positive 96% » 






17 . 



Rank In order the kinds of information you would like to have about 
White Bear Lske Senior High Schools 

% Ranked 76% Curriculum and program 
First 

11% Costs 

7% Calendar of events 
5% Minutes of School Board meetings 
Other - whet? 

18. How do you usually find out what is going on at the high school? 
5Q7» students 

77 . Teachers or other school personnel 
77. Friends or neighbors 
33% Newspapers, radio or television 
1% Newsletter 
Other - what? 

19* How do you feel you can best be kept informed about the school? 

23% Students 

287. Newspapers, radio or television 
33% Newsletter 
13% Meetings 
37. Other - what? 



20. Do you feel that the White Bear Lake Senior High School administration is 
generally sensitive or generally Insensitive to the community's educational 
needs and desires? 

+607. S Sensitive 777. Insensitive 181 



i 



21. Should tbpr* ho rorc citizen Involvement In making school decisions? 

Yoa 67 % so 

If Yes, concerning v;nat areas? 

20% - General 
13% - New programs 

22# Rank In order what you feel Is the most effective means of reporting a 
student's progress: 

3 Report card 

1 Parent -teacher conference 

2 Written statement by .teacher 
Other - what? 



23# Is the new design at White Bear Lake Senior High School more# the same# 
or less expensive than the traditional system? 

More 54% Same 16% Lc88 14% 

If More# Is It worth the cost? 

Yes 30% No 21% 




24. If more money were made available to the senior high# where should this 
money be spent? 

34% Smaller classes 

10% Additional courses 

3% Teacher salaries 

3% More teacher training for present teachers 
18% Educational materials 
20% Facilities 

6% Communication with community 
3% Other - what? 




I 

[ 

I 

I 



I 



25. Are there r.ny other comments you would like to make about White Bear Lake 
Senior High School? 

61% made no comment. A total of 155 comments were offered. 

9 said the facilities were overcrowded. 

9 said teachers and counselors were unavailable. 

8 said there was too much free time. 

8 said more supervision and control was needed. 

7 said it was a good school and a good program. 



I. 



BACKGROUND INFORMATION: 
Name : 



59 Parents; 
41 Males; 



35 Non-parents 
53 Females 



Address: 



(of those interviewed) 

II. Education (Last school year completed) 12% non-high scho ol graduates 

44% were high school graduates 
39% had post high school training 

(Spouse) 5% had post college training 



III • Occupation : 



(Spouse) 



less 

IV. Age Estimate: than20-25 3% 25-30 10% 30-35 _H_ 

35-40 22% 40-45 24% 45-50 17% 50-55 7% 

55-60 37 ° 60-65 65-70 4% 70-75 L 

and over ; 

less 

. Length of Residence in White Bear Lake : than 5 yrs. 22% 10-25 yrs. 43% 

x 5-10 yrs. 19% over 25 16% 



V 
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APPENDIX C 



I 



TEACHER QUESTIONNAIRE 
WHITE BEAR LAKE SENIOR HIGH SCHOOL 




Ce! 



i 



This instrument is the property of the Educational Research and Development Council 
of the Twin Cities Metropolitan Area, Inc., 211 Burton Hall, University of Minnesota, 
Minneapolis, Minnesota. It was developed in collaboration with the White Bear Lake 
Senior High School Evaluation Conmittee. Copyright (C) 1970, Wayne W. Welch. 



SENIOR HIGH SCHOOL QUESTIONNAIRE 



I 
I 

I 

Number of Respondents » 143 



Below are listed a number, of statements about your senior high 
school , its students , and teachers. Please circle the appropriate 
letters that describe how you feel about the statement. Circle: 

DD if you strongly disagree with the statement. 

D if you disagree mildly with the statement. 

A if you agree mildly with the statement. 

AA if you 8 trongly agree with the statement. 



Desired 

Level 


u 

V 

u 

00 

< 


<D 

n 


Thank you for helping us in this evaluation. 




8-8 


u 

o 


I. 




+95% 


76% 


P 


1. All students should have the opportunity to attend a school with 
modular scheduling. 


+90% 


64% 


P 


2. The senior high school has better teachers than other area 
schools . 


high 


-50% 


48% 


A 


3. Students are given too much responsibility for their own learning. 


-25% 


27% 


A 


4. There are more discipline problems among our students than 
other schools. 


in 


+90% 


73% 


P 


5. The majority of our students are satisfied with the school 


• 


-10% 


10% 


A 


6. Most of our teachers care more for getting high salaries than for 
improving s tudents * learning . 


-10% 


94% 


P 


7. The school facilities are Inadequate for present needs as 
and design. 


Co size 


+75% 


76% 


A 


8. Students are evaluated and graded fairly. 





DD D 

DD D 
DD D 

DD D 
DD D 

DD D 

DD D 
DD D 




Lo 3 



A AA 

A AA 
A AA 

A AA 
A AA 

A AA 

A AA 
A AA 



Desired 

Level 


*0 

01 

0) 




M 

00 

< 


Code 

to 

• 


+ 50% 


64% 


S 9. 


+ 904 


o*- 

00 


A 10. 


-10% 


61% 


P 11. 


-20 


20% 


A 12. 


-254 


21% 


A 13 ‘ 


-20% 


66% 


P 14. 


-504 


32% 


S 15. 


-10 4 


19% 


A 16. 


+60 4 


78% 


S 17. 


-40 4 


6% 


S 18. 


-104 


1% 


A 19. 


+80 4 


66% 


P 20. 


-10 4 


10% 


> 

to 

I- 1 

• 


+ 50 


71% 


• 

CM 

CM 

CO 




18% 


23. 


+80 4 


82% 


A 


+75 4 


92% 


S 25. 



The tax dollar is being well spent on the high school. 

The senior high school is providing quality education for the 
children of the comnunity. 

Less independent study time should be given to students. 

Use of individual performance standards to judge student progress 
tends to lower the quality of work produced. 

Too many different courses are offered in the high school* 

More than half of their independent study time is wasted by 
students . 

Too much emphasis is placed on inter-scholastic athletics* 

Students can learn better in a regular class than through 
individualized instruction. 

Team teaching contributes to improved student learning. 

Students should be limited to a maximum of four courses at any 
one time. 

Listening to the teacher lecture is the best way for high school 
students to learn. 

Teachers are readily available to consult with individual students. 

Instructional secretaries, teacher aides, media specialists, and 
other supportive staff are too costly for the value they provide. 

The most useful component of modular scheduling is the small 
group . 

There should be no required courses in senior high school. 

I would recommend our high school to a friend. 

There is an adequate variety of extracurricular activities for 
students . 



DD D 

DD D 
DD D 

DD D 
DD D 

DD D 
DD D 

DD D 
DD D 

DD D 

DD D 
DD D 

DD D 

DD D 
DD D 
DD D 

DD D 



t 





A AA 

A AA 
A AA 

A AA 
A AA 

A AA 
A AA 

A AA 
A AA 

A AA 

A AA 
A AA 

A AA 

A AA 
A AA 
A AA 

A AA 



3. 



I 

! 



Desired 

Level 


% Checked 


Code 


II, 

In 

is 


3 

» 

the spaces below, mark with a (v') any areas where you think real improvement 
needed in the senior high school. 


-20% 


83% 


P 




buildings and facilities 


-20% 


13% 


A 




Job placement 


-20% 


5% 


S 




athletic program 


-20% 


60% 


P 




student control 


-20% 


18% 


A 




school administration 


-20% 


42% 


P 




individualized instruction 


-20% 


35% 


P 




curriculum 


-20% 


22% 


A 




teachers' salary 


-20% 


11% 


A 




career information 


-20% 


4% 


S 




extracurricular activities 


-20% 


23% 


A 




instruction 


-20% 


16% 


A 




resource materials 


-20% 


32% 


P 




school board decision making 


-20% 


35% 


P 




personal counseling 


-20% 


55% 


P 




parent -teacher communication 


-20% 


1% 


A 




none that are obvious 


-20% 


10% 


A 




others (list them) 



III. 



no 

0) «-< 
U 0) 
> 

W 0) 
0) hJ 
Q 



-O 

a 

5 

o 



0) 

no 

O 

a 



Mark with a (>/") those words that in your opinion describe the flexible modular 
scheduling program being used in the senior high school. Check all words you 
think are applicable. 



+75% 


74% 


A 


useful 


-25% 


34% 


A 


expensive 


+75% 


73% 


A 


innovative 


-25% 


12% 


S 


harmful 


-25% 


9% 


S 


dangerous 


+75% 


59% 


P 


effective 


-25% 


13% 


S 


impersonal 


-25% 


0 


S 


old 


+75% 


60% 


P 


stimulating 



I 




-25% 


l\% 


S 


unnecessary 


+75% 


62% 


P 


valuable 


-25% 


10% 


S 


rigid 


-25% 


1% 


S „ 


traditional 


-25% 


8% 


S 


poor 


+75% 


66% 


A 


ind ividualizing 


+75% 


18% 


P 


adequate 


-25% 


6% 


S 


extravagant 









m 



T3 

0) »— l 

u <u 

•H > 
W <U 
<U 
Q 



0) 

0) 

U 

to 



4. 

IV. 

FOR TEACHERS ONLY . 

Years taught in White Bear Lake 
Sex M 63 F 36 



0) 

TJ 

O 

O 



+ 807. 


527. 


P 


1. 


I Jtnow my students better under the modular schedule than I did 
under a traditional program. 


DD 


D 


A 


AA 


-107. 


127. 


A 


2. 


This evaluation of the high school is a waste of money. 


DD 


D 


A 


AA 


+857. 


OO 


A 


3. 


Written behavioral objectives are useful in teaching my courses. 


DD 


D 


A 


AA 


+9u,‘. 


617. 


P 


4. 


The in-service programs have improved my teaching. 


DD 


D 


A 


AA 


-257. 


227. 


A 


5. 


The faculty senate is a waste of time. 


DD 


D 


A 


AA 


-107. 


147. 


A 


6. 


My students proceed through th£ clz&s materials at the same pace 
throughout tho year 


DD 


D 


A 


AA 


••807. 


737, 


A 


?. 


V use written ituder.t evaluations of my courses to improve 
instruction. 


DD 


D 


A 


AA 


-257. 


427. 


P 


8. 


The majority of school decisions are made without consulting 
teachers . 


DD 


D 


A 


AA 


-257. 


137. 


S 


9- 


I prefer traditional scheduling to modular scheduling. 


DD 


D 


A 


AA 


-257. 


307. 


A 


10* 


Thi; N grad a should be abolished. 


DD 


D 


A 


AA 



If so, why?_ 



+90/907. 11. With what percent of your students have you had a private conference 

18/907. P this 7 ear? 



-107. 77. A 

-107. 327. P 
-107. 307. P 



12. Check which of the following supportive staff are nc£ being used 
effectively: 

clerical staff 



interns 

media ari4 s^terial specialists 



+907 927 A 13 • Do you enjoy teaching at White Bear Lakt Senior High School? 



No 



Yes 



. © 

ERIC 



b(. 




5 . 



V. TEACHERS 

In column I circle YES or NO for those changes you think have occurred 

in the senior high school during the past three years. In column II, 

circle YES or NO If you think the "new educational plan" is the main 

_ cause of the change, 

a) »h 



co a) 
a) p 
P 


JM 


T3 

0 

O 


I. 


HAVE OCCURRED 


CHANGE 


ii. 


CAUSED 


BY THE NEW FLAN 


+7 5% 


89% 


s 


1. 


YES 


NO 


Higher teacher salaries 


7 


. Yes 
10% 


YES 


NO 


-25% 


42% 


p 


2. 


YES 


NO 


More discipline problems 




55% 


YES 


NO 


+7 5% 


68% 


A 


3. 


YES 


NO 


Improved learning * 




73% 


YES 


NO 


+75% 


87% 


S 


4. 


YES 


NO 


More individualized instruction * 




89% 


YES 


NO 


+7 5% 


64% 


A 


5. 


YES 


NO 


Improved administration 




52% 


YES 


NO 


+75% 


43% 


P 


6. 


YES 


NO 


Better facilities 




43% 


YES 


NO 


-25% 


6% 


S 


7. 


YES 


NO 


Poorer athletic teams 




6% 


YES 


NO 


+7 5% 


70% 


A 


8. 


YES 


NO 


Greater professional role for teachers* 


69% 


YES 


NO 


+7 5% 


85% 


S 


9. 


YES 


NO 


More staff assistance* 




82% 


YES 


NO 


+75% 


66% 


A 


10. 


YES 


NO 


Better student-teacher relations* 




76% 


YES 


NO 


-25% 


8% 


S 


11. 


YES 


NO 


Less challenging teaching* 




27% 


YES 


NO 


+75% 


82% 


A 


12. 


YES 


NO 


More teacher freedom * 




87% 


YES 


NO 


+75% 


46% 


P 


13. 


YES 


NO 


Differentiated staffing * 




46% 


YES 


NO 


+75% 


87% 


S 


14. 


YES 


NO 


Greater variety of media used * 




81% 


YES 


NO 


+75% 


92% 


S 


15. 


YES 


NO 


More courses for students* 




91% 


YES 


NO 


CT-- 

m 

CM 

1 


5% 


S 


16. 


YES 


NO 


Fewer in-service programs* 




31% 


YES 


NO 


+75% 


36% 


P 


17. 


YES 


NO 


Better teacher -teacher relations 




63% 


YES 


NO 


+75% 


77% 


A 


18. 


YES 


NO 


More student responsibility* 




82% 


YES 


NO 


-25% 


53% 


P 


19. 


YES 


NO 


Less school spirit 




41% 


YES 


NO 



* items test "new program" 
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APPENDIX C 

SCHOOL SURVEY 

Number of Respondents ® 141 



Code Number 



CODE NUMBER Please write your code number in the space provided at the top of this page NOW 

INSTRUCTIONS This inventory contains 120 statements covering your opinions and attitudes about 
your work. Read each one carefully, and decide how you feel about it. You will agree with some 
statements and disagree with others. You may be undecided about some. To help you express your 
opinion, three possible responses are given beside each statement. All you have to do is choose the 
response that most nearly reflects your opinion, and mark an "X" in the box under it Use a pencil, 
and. if you make an error or wish to change your answer, simply make an erasure and then mark an 
"X" in the proper box 

WORK RAPIDLY, BUT ANSWER ALL STATEMENTS. Do not spend too much time on any one state- 
ment Some of the statements may not be worded exactly the way you would like them to be However 
answer them as best you can Be sure to respond to every statement Mark only one box for each 
statement If you cannot really decide about a statement, mark the "? " box and go on to the next 
statement. This is not a test; there are no “right" or “wrong" answers 

GENERAL INFORMATION Statements about "immediate supervisor" refer to the person to whom you 
are immediately accountable in the performance of your duties "Administration" refers to all person 



s-s 

s 

n 

o 

55 


WBL % 
Code 


who are one step above your immediate supervisor, all the way up to and including the superintendent 
and central office personnel , 

Agree ? Disagi 


66% 


58% A 


1 


People in this community are "education-oriented 


□ 


□ 


□ 


68% 


48% P 


2 


Many staff people here are more concerned with their own 
personal interests than with the over-all welfare of the school 


□ 


□ 


□ 


77% 


82% A 


3. 


j 

My work here provides me with ample opportunity for personal 
growth and development . 


□ 


□ 


□ 


68% 


73% A 


4 


I have plenty of opportunity here to express my ideas about 

salary matters 


□ 


□ 


□ 


72% 


67% A 


5. 


This school assumes too many educational responsibilities that 
properly belong in the home or to other community agencies 


□ 


□ 


□ 


72% 


50% P 


6 


It seems to me that the school board should reconsider the amount 
of authority it has delegated to the top administration 


□ 


□ 


□ 


79% 


72% A 


7 


Insofar as they affect me, decisions made by the administration 
are fair and equitable 


□ 


□ 


□ 


82% 


53% P 


8 


I am asked to read too many communications from higher-ups in this 
school system 


□ 


□ 


□ 


43% 


79% S 


9 


Our library services for students are very satisfactory 


□ 


□ 


□ 


60% 


53% A 


10. 


The work of staff specialists in this school (guidance counselors, 
librarians, social workers, nurses, etc. ) is well coordinated with 
the work of the classroom teachers 


□ 


□ 


□ 










Go on 


to next 


pa B e 



Copyright 19*6 
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u 
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WBL 


HD 

0 

O 






70% 


62% 


A 


11. 


I am asked to spend too much time in meetings around here 


48% 


55% 


A 


12 


Our salary system fails to compensate us sufficiently for 
years of service 


84% 


85% 


A 


13. 


My immediate supervisor backs me up in my dealings 
with parents 


58% 


31% 


P 


14. 


Physical facilities for our personal use (lounge, washroom. 

etc. ) need to be greatly improved 


60% 


78% 


S 


15. 


The salary schedule here gives me little incentive to seek 


60% 


43% 


P 


16. 


From all I can gather, people who get promotions around here 


59% 


45% 


P 


17. 


Certain community pressure groups exert too much influence 
on the professional work of this school • 


47% 


59% 


S 


18 


The quality of supplementary materials for student use here 
needs to be greatly improved . 


58% 


31% 


P 


19 


The school board seems more concerned about keeping costs 
down than about building an effective school program 


22% 


29% 


A 


20. 


I feel our salary system adequately rewards outstanding work 


80% 


67% 


P 


21 


I think my work performance is judged fairly here 


40% 


47% 


A 


22 


The curriculum and methods assistance provided classroom 
teachers in tnis school is clearly effective 


58% 


85% 


S 


23 


The instructional materials provided for me here are 
very satisfactory 


50% 


62% 


S 


24 


A student here sometimes has to do without needed 


69% 


66% 


A 


25 


l.ittle effort is made here to evaluate the effectiveness of 
our instructional program 


46% 


77% 


S 


26 


The school library and reference materials are adequate 


56% 


28% 


P 


27. 


I think the school board does all it can to help build an 
effective educational program 


81% 


81% 


A 


28 


My immediate supervisor seldom tries to get my ideas 



about things 



Agree 


° Disagree 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


n 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


Agree 


o 


Disagree 


□ 


□ 


□ 


□ 


n 


□ 


□ 


□ 


□ 


a 


□ 


□ 


□ 


□ 


□ 


Agree 


0 


Disagree 


□ 


□ 


□ 


□ 


□ 


n 


□ 


□ 


G 


□ 


□ 


D 


G 


□ 


C 


□ 


□ 


□ 


□ 


□ 


□ 




2 

<,9 



Go on tonext page 



1 


NORM % 


<tf 

d *2 

S 8 






Agree 


0 


Disagree 


T 


577. 


347. P 


29 


School policy here for student promotion and retention 

is sound 


□ 


□ 


□ 


- 


717. 


727. A 


30 


The content of the textbooks my students use is poor 


□ 


□ 


□ 


: 


737. 


727. A 


31 


As far as I'm concerned, extracurricular duties 
(sponsoring student clubs and activities, etc ) 

are distributed fairly here 


□ 


□ 


□ 


). 


807. 


717. P 


32 


Most of the students 1 work with are at the grade level 

that is best for them 


□ 


□ 


□ 




847. 


867. A 


33. 


1 would prefer a different work assignment (grade level. 

subject matter, etc. ) from the one I now have 


□ 


□ 


□ 




797. 467. P 


34 


In general. I approve of school board policies 


□ 


□ 


□ 


1 


637. 


727. A 


35 


It is easy and convenient to get teaching aids and equipment into 
the classroom here 


□ 


□ 


□ 



erJcI 



57% 26% P 36. 
55% 53% A 37. 
70% 66% A 38 
61% 32% P 39 

80% 60% P *<0 
52% 33% P 41 



It seems to mo that the school board fails to concern 
itself with some really important educational matters 



The procedures for judging my performance are helpful 
to me in improving my work 



Employee benefits here (sick leave, tuition refunds, 
personal leave, etc ) fail to fit our needs 



Almost all students here seem well prepared for 
advancement to the next grade level 



In general, the parents of the students here are interested in 
helping us educate their children 



I'm rarely told whether or not I'm doing good work 



bb 



Agree 0 Disagree 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

Agree 0 Disagree 





497. 


267. P 


42 


There is an adequate program of student-teacher 


□ 


□ 


□ 










consultation here after each reporting period 


- 


807. 


747. A 


43 


I am seldom encouraged to attend outside professional 
conferences and workshops . . 


□ 


□ 


□ 


v 


687. 


657. A 


44 


I fail to understand how my work performance is evaluated 


□ 


□ 


. □ 


-i 


687. 


847. S 


45. 


I have sufficient supplies for my work 


□ 


□ 


□ 


< 


687. 


757. A 


46. 


I have adequate opportunity to express my viewpoints 

about the philosophy and goals of this school. 


□ 


□ 


□ 


jj 


667. 


727. A 


47. 


The parents of students exert too great an influence on 


□ 


□ 


□ 










educational matters in this school. 












Go on to 


next 


page. 


i 








3 









i 



Agree 



Disagree 



Norm % 


a 

§ 


Code 






50% 


30% 


p 


48 


Our system for reporting student progress to parents 
needs considerable improvement 


76% 


83% 


A 


49. 


We are permitted to discuss controversial 
matters with students as long as we remain 
objective and factual 


68% 


74% 


A 


50 


The administration seems to be willing to / 

give careful consideration to our ideas 

and suggestions 


68% 


78% 


A 


51 


My immediate supervisor keeps me well informed about 

matters affecting my work 


79% 


53% 


P 


52. 


This school lacks an "atmosphere of learning " 


64% 


58% 


A 


53. 


My salary is sufficient to give me a reasonable 

amount of security 


49% 


74% 


S 


54. 


The specialized programs here (music, art, 
drama, physical education, etc ) need to 
be greatly improved 


47% 


75% 


S 


55 


My immediate supervisor seems to have sufficient influence 
with his superior in deciding what goes on in our work 


66% 


14% 


P 


56 


Relations between the parents of students and the staff of 

this school need to be improved 


82% 


24% 


P 


57 


The superintendent seems to have an effective working relationship 
with the school board . 


36% 


33% 


A 


58 


Effective remedial help is available to any of my students 
who are failing in school 


48% 


62% 


S 


59 


1 should have a greater voice in selecting student 
textbooks and reference materials 


82% 


89% 


A 


60 


There is a spirit of willingness to experiment with 
new curriculum ideas in this school 


73% 


81% 


A 


61 


. 1 seldom get the help 1 need in handling difficult 
discipline cases 


66% 


48% 


P 


62. 


The school board seems to recognize the professional 
character of our work in the schools . 


53% 


48% 


A 


63. 


The emphasis on academic subjects in this district sometimes 
operates to the detriment of students who will not be pursuing 
academic programs later 






55% 


45% 


A 


64. 


The number of students 1 have to work with makes it 



difficult for me to do a good job 



4 



□ 

n 


□ 


□ 

□ 


□ 


□ 

□ 


□ 


□ □ 


□ 


□ □ 


□ 


□ 

□ 


□ 


Agree 0 


Disagree 


□ 

□ 


D 


□ 

n 


□ 


□ 

□ 


□ 


□ 

□ 


□ 


□ 

□ 


□ 


□ 

n 


C 


□ 

□ 


□ 


Agree 0 


Disagree 


□ 

□ 


□ 


□ C 


G 


□ 

□ 


□ 


□ 

□ 


□ 


Go on to next 


fKlgP 



0/ 



u 

a o 
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H3 

O 
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Agree 


? 


Disagree 


41% 

1 


32% 


A 


65. 


The school board seems to be interested in 
obtaining our ideas and suggestions 


□ 


□ 


□ 


1 65% 

I 


50% 


P 


66. 


I am required to do too much administrative paper 
work (attendance reports, tardy slips, 
statistical reports, etc. ) 


□ 


□ 


□ 


; 48% 


44% 


A 


67. 


For my level of professional competence, 1 am adequately 
rewarded financially 


□ 


□ 


□ 


| 70% 


61% 


A 


68. 


The administration seems to lack interest in the 

personal welfare of the faculty of this school 


□ 


□ 


□ 


r 65% 


53% 


P 


69. 


Most of the time it's safe to say what you think around here 


□ 


□ 


□ 


50% 


33% 


P 


70. 


In my opinion, the school board, seems to be divided on too many 


□ 

□ 


□ 

□ 


□ 

□ 










issues 


} 

i 43% 


66% 


S 


71. 


In working with my students, I have adequate opportunity to 
allow for their individual differences 


i 










Agree 


9 


Disagree 


56% 

\ 

j 


41% 


P 


72. 


We lack satisfactory procedures here for evaluating 
student progress 


□ 


□ 


□ 


62% 


48% 


P 


73. 


Administrative matters seem to get more attention here 


O 


□ 


□ 


:■ 








than the educational program 


| 55% 


43% 


P 


74. 


There is adequate space and equipment for carrying out 
my work- -including desk space, drawers, bookshelves. 


□ 


□ 


□ 










and the like 


1 67% 


61% 


A 


75 


I am required to perform too many non- professional 


i 








duties here (yard. hall, stair, lunchroom, and 
study hall duties) 


□ 


□ 


□ 


! 84% 


48% 


P 


76. 


People in this school cooperate well 


□ 


□ 


□ 


f 










Agree 


9 


Disagree 


66% 

1 


81% 


S 


77 


The students 1 work with seem to need an unusual 

amount of discipline 


□ 


□ 


□ 


1 79% 


86% 


A 


78. 


My immediate supervisor fails to "go to bat M for 

us with his superiors 


□ 


□ 


□ 


| 75% 


66% 


A 


79. 


The buildings and grounds where I work are kept as 

clean and attractive as possible 


□ 


□ 


□ 


| 59% 


46% 


P 


80. 


Ir. my opinion, our specialized services (EMH, speech therapy. 

guidance counseling, social work, etc. ) fail to effectively 

meet the needs of students 


□ 


□ 


□ 


| 88% 


84% 


A 


81. 


Generally speaking, I feel I could do far better work with 
students different from those usually assigned to me 


□ 


□ 


□ 



I 



ERIC 4 /J 



5 



Go on to next page. 
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517. 357. P 


82 


687. 717. A 


83 


787. 367. P 


84 


827. 897. A 


85 


527. 367. P 


86. 


557. 647. A 


87 


757. 437. P 


88 



Our standards for giving grades to students are satisfactory . 

My immediate supervisor seldom shows initiative in 
seeking ways to help us in our work . . . . 

There are many cliques or groups in this school that 

create an unfriendly atmosphere 

Interruptions (messages, monitors, intercom bullet ins ) 
are kept to a minimum here 

Adequate facilities are available for my use during off- 
periods for grading papers, meeting with students and 
parents, and the like 

The administration usually tries to take action on faculty 
complaints 

The poor work performance of some people on this 
school staff makes it difficult to achieve adequate 
instructional goals 



88% 91% A 89 
81% 62% P 90. 

75% 53% P 91. 
62% 91% S 92 

68% 82% S 93 

51% 71% S 94 



My immediate supervisor is fair in his dealings with me 

The general physical condition of my work place 
(lighting, temperature, ventilation, etc ) hamper 
me in doing a good job ...... 

A few of the people in this school think they run the place 

1 receive sufficient clerical assistance to do niv 

job effectively % 

There is little opportunity for me to take part in the 
development of the curriculum of this school 

This school system fails to provide adequately for the needs 
of exceptional students (slow learners, gifted students, 
the handicapped) 



797. 


757. 


A 


95. 


My professional work load is fair and reasonable 


457. 


377. 


A 


96. 


Too many students here seem to be more interested 
in getting grades than in learning 


657. 


407. 


P 


97 


The classrooms, offices, and other work areas here 
need considerable improvement 


587. 


537. 


A 


98 


Most of the meetings I am required to attend here are worthwhile 


677. 


457. 


P 


99 


There seems to be too much friction between administrators 
in this district 



Agree 




1 hsagrt-t* 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ " 


n 


Agree 


j 


Disagree 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


Agree 


•> 


Disagree 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


Go to 


next page 
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Agree 



Disagree 



6 ^ 



Norm ' 


WBL 7. 


Code 






45% 


45% 


A 


100. 


Too often we are asked to work on committees whose efforts and 
reports are subsequently ignored * 


73% 


77% 


A 


101. 


This school district lags behind other districts of comparable size 
and financial resources in introducing up-to-date materials and 
equipment 


70% 


50% 


P 


102. 


The layout of this school is inconvenient for the staff 


76% 


70% 


A 


103. 


Even when you take into account differences in student ability, 
other schools in this locality seem to be ahead of this one in 
educational effectiveness 


71% 


62% 


A 


104. 


My recommendations about promoting and retaining students 
are usually followed 


42% 


53% 


S 


105. 


I feel our school system is one big reason why people choose 

to live in this community 


78% 


70% 


A 


106 


My immediate supervisor seems to take suggestions for 
improvement as a personal criticism 


52% 


56% 


A 


107, 


We are seldom kept informed about what the school board 

and top administration are thinking 


54% 


OO 

s-s 


S 


108. 


1 would rate this district as one of the best for those who 

want to work in education 


53% 


59% 


A 


109. 


This district's in-service educational program helps 

me improve my professional skills 


55% 


52% 


A 


110. 

4 


Jobs in this school district seem to be graded fairly with 
respect to salary 


85% 


62% 


P 


111. 


In my opinion, adequate educational standards are 

being upheld in this school 


65% 


5^ 

CO 

<1* 


P 


112. 


I'm essentially in agreement with the school's student 

retention policy 


80% 


82% 


A 


113. 


My immediate supervisor has an unrealistic view of what 

goes on in my work situation 


82% 


74% 


P 


114. 


Teachers and other professional personnel in this school 

freely share ideas and materials 


59% 


72% 


S 


115. 


Compared with other school districts in this locality, 

our salary scale here is okay 


73% 


82% 


A 


116. 


My students show normal consideration, courtesy, 

and respect 



□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

Agree ? Disagree 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ a 

Agree ? Disagree 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 



Go to next page. 
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A g 


1 


MSil!'! 


82% 247. P 


117. 


Student absences are excessive in this school . 


□ 


n 


□ 


737. 707. A 


118 


I would definitely recommend this school to prospective 
teachers as a good place to work 


□ 


□ 


□ 


667. 627. A 


119. 


Filling in this survey questionnaire is a poor way of finding out 
how I feel about my work in this district 


□ 


□ 


G 


80% 817. A 


120 


Some good may come out of filling in this questionnaire 


□ 


□ 


□ 



COMMENTS. 
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STUDENT QUESTIONNAIRE 



WHITE BEAR LAKE SENIOR HIGH SCHOOL 







I 



This instrument is the property of the Educational Research and Development Council 
of the Twin Cities Metropolitan Area, Inc#, 211 Burton Hall, University of Minnesota, 
Minneapolis, Minnesota# It was developed in collaboration with the White Bear^Lake 
Senior High School Evaluation Committee* Copyright © 1970, Wayne W# Welch# 
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SENIOR HIGH SCHOOL QUESTIONNAIRE 

| Number of Respondents = 293 

I 

J Below are listed a number of statements about your senior high 

school, its students, and teachers. Please circle the appropriate 

I 

I letters that describe how you feel about the statement. Circle: 

j DD if you strongly disagree with the statement. 

D if you disagree mildly with the statement. 

J A if you agree mildl y with the statement. 

AA if you strongly agree with the statement. 



no 

m 


0) 

0) 




Thank you for helping us in this evaluation. 










Desir< 

Level 


kl 

00 

c 

e-? 


Code 


i. 












+7 5% 


887, 


s 


i. 


All students should have the opportunity to attend a school with 
modular scheduling. 


DD 


I) 


A 


AA 


+707. 


647, 


A 


2 . 


The senior high school has better teachers than other area high 
schools . 


DD 


D 


A 


AA 


-507, 


247. 


S 


3. 


Students are given too much responsibility for their own learning. 


DD 


D 


A 


/■Li \ 


-257. 


347. 


A 


4. 


There are more discipline problems among our students than in 
other schools. 


DD 


1) 


A 


AA 


+907. 


747. 


P 


5. 


The majority of our students are satisfied with the school. 


DD 


I) 


A 


AA 


-257. 


397. 


P 


6. 


Most of our teachers care more for getting high salaries than for 
improving students 1 learning. 


DD 


D 


A 


AA 


-107. 


697. 


P 


7. 


The school facilities are inadequate for present needs as Co size 
and design. 


DD 


D 


A 


AA 


+7 57. 


667. 


A 


8. 


Students are evaluated and graded fairly. 


DD 


D 


A 


AA 



/) 

t - - - - — 



Des ired 
I. eve l 


% Agreed 


Code 


2. 












+50% 


50% 


A 


9. 


The tax dollar is being well spent on the high school. 


1)1) 




A 


AA 


+ 70% 


85% 


S 


10. 


The senior high school is providing quality education for the 
children of the community. 


1)1) 


\) 


A 


A A 


-10% 


16% 


A 


11. 


Less independent study time should be given to students. 


Pi) 


D 


A 


AA 


-20% 


CM 

cn 


P 


12. 


Use of individual performance standards to judge student progress 
tends to lower the quality of work produced. 


D!) 


L> 


A 


AA 


-20% 


6% 


S 


13. 


Too many different courses are offered in the high school. 


DP 


i) 


A 


AA 


-20% 


52% 


P 


14. 


More than half of their independent study time is wasted by 
s tudents . 


1)1) 


1) 


A 


AA 


-50% 


24% 


S 


15. 


Too much emphasis is placed on inter -scholastic athletics. 


1)1) 


1) 


A 


A A 


-25% 


20% 


A 


16. 


Students can learn better in a regular class than through 
individualized instruction. 


Dl) 


1) 


A 


AA 


+60% 


70% 


S 


17. 


Team teaching contributes to improved student learning. 


DD 


l) 


A 


AA 


-40% 


12% 


S 


18. 


Students should be limited to a maximum of four courses at any 
one time. 


1)1) 


1) 


A 


AA 


-30% 


13% 


s 


19. 


Listening to the teacher lecture is the best way for high school 
students to learn. 


DI) 


I) 


A 


AA 


+ 80% 


49% 


p 


20. 


3 

Teachers arc readily available to consult with individual students. 


DD 


I) 


A 


AA 


- 10% 


36% 


p 


21. 


Instructional secretaries, teacher aides, media specialists, and 
other supportive staff are too costly for the value they provide. 


DD 


D 


A 


AA 


+ 50% 


80% 


s 


22. 


The most useful component of modular scheduling is the small 
group. 


Dl) 


D 


A 


AA 




41% 




23. 


There should be no required courses in senior high school. 


DD 


D 


A 


AA 


+80% 


85% 


A 


24. 


I would recommend our high school to a friend. 


DD 


I) 


A 


AA 


+ 7 5% 


80% 


A 


ro 

LA 


There is an adequate variety of extracurricular activities for 
students . 


DD 


I) 


A 


AA 






o 



II 



3. 















a 












0) 




o 




u 


H 


a> 




•H 


0) 


x: 


a> 


w 


> 


a 


TJ 


0) 


0) 


B-S 


o 


a 


hJ 


a 



In the spaces below, mark with a (vO any areas where you think real improvement 
is needed in the senior high school. 



-20% 41% P 

| -20% 14% A 

-20% 8% S 

-20% 30% P 

-20% 20% A 

-20% 21% A 

-20% 9% S 

-20% 12% A 

-20% 22% A 

-20% 10% S 

-20% 12% A 

-20% 20% A 

-20% 27% A 

-20% 15% A 

-20% 15% A 

-20% 12% A 

-20% 15% A 



buildings and facilities 
job placement 
athletic program 
student control 
school administration 
individualized instruction 
curriculum 
teachers* salary 
career information 
extracurricular ar.tivit iu.s 
ins truce i on 
resource materiiJs 
school hoard decision making 
personal counseling 
parent-teacher communication 
none that are obvious 
others (list them) 



a) 

u 



"O 

a) 

* 

a 

a 



III. 

Mark with a (s/) those words that in your opinion describe the iicxible modular 
scheduling program being used in the senior high school. Choc* all words you 



-h m 
« > 
a) a) 
a *4 


a 


Code 


think are applicable. 










+75% 

-257, 


5-2 g-2 

<r o 

00 CM 


A 


use ful 


-25% 

+75% 


7% 

58% 


S 

P 


unnecessary 


A 


expensive 


valuable 


+75% 


12% 


P 


innovative 


-25% 


8% 


s 


riKid 


-25% 

-25% 


8% 

7% 


s 


harmful 


-25% 

-25% 


2% 

7% 


S 

S 


tradi t iona 1 


S 


dangerous 


poor 


+75% 


66% 


A 


e f fective 


+75% 


57% 


P 


ind ividua lizing 


-25% 


11% 


s 


impersona 1 


+75% 

-25% 


39% 

6% 


p 


adequate 


-25% 

+75% 


2% 

36% 


S 

P 


old 


c 


extravagant 


stimulating 


o 





O 

f ERIC 



%d 



■ 



4. 



IV. 









FOR 


STUDENTS ONLY. 










Des ired 
Level 


% Agree< 


Code 


CHECK: Grade: 10 377. 11 327. 12 297. Sex: 


M AL 


F 


■52. 


+757. 


737. 


A 


1. 


Greater freedom of movement within the school has created a better 
learning environment. 


DD 


l) 


A 


AA 


+ 7 57. 


567, 


P 


2. 


Teachers are available for individual help. 


DO 


D 


A 


AA 


-207. 


287, 


A 


3. 


There is no place in the school to go for self-study. 


DD 


D 


A 


AA 


-257. 


347. 


A 


A. 


The N grade should be abolished. 


Dl) 


D 


A 


AA 




427, 




5. 


There should be no required courses. 


DD 


D 


A 


AA 


+7 57. 


567, 


P 


6 . 


I feel most of my teachers are interested in me as a person. 


DD 


I) 


A 


AA 


-2 57. 


387. 


P 


7. 


Certain departments have discouraged the taking of extra courses 
by students. 


DI) 


D 


A 


AA 


+ 507, 


61.7 


S 


8 . 


The curriculum has been individualized to meet my needs. 


DD 


0 


A 


AA 


+ 7 57. 


40% 


P 


9. 


I feel a counselor is helpful to me in working out my personal 
problems . 


DD 


D 


A 


AA 


-257. 


317, 


A 


10. 


Most of my courses are very boring. 


DD 


D 


A 


AA 


- 207. * 


447. 


P 


11. 


I am not personally involved in the activities of the school. 


DD 


D 


A 


AA 


+ 7 57. 


777. 


A 


12. 


There is enough freedom in course selection to meet the personal 
needs of the students. 


DD 


D 


A 


AA 


+ 7 57. 


567. 


P 


13. 


The school administration is interested in the students. 


DD 


D 


A 


AA 


+807. 


567. 


P 


14. 


I have had a private conference this year with at least one of my 
teachers. 


No 




Yes 


- 1 0 7. 

+ 107 ; 


ima 

107 


A 


15. 


What percent of your class meetings do you skip on the average 
each week? 






% 




-207. 


16% 


A 


16. 


What percent of your unscheduled time do you think is wasted 
each week? 










+ 50% 


507. 








% 




-1-40% 
6 cr 


407. 


A 


17. 


In how many courses are you enrolled this semester? 










6 cr 










+ 507. 


337. 


P 


18. 


Are you involved in an independent study program for any of your 
courses' 


No 




Yes 


+ 507. 


577, 


A 


19. 


Have you ever >/isited a class in which you were not enrolled as 
a regular student? 


No 




Yes 




<&\ 



*> 



20. What is the best thing about White Bear Lake Senior High School? 



21. What is the greatest problem with the senior high school' 



-o 

o 

W r -4 
■H O 
W > 

<y cy 

a ,-j 



+3.0 

+3.0 

-3.0 

“3.0 

“3.0 

-3.0 

+3.0 

“3.0 

-3.0 

-3.0 

-3.0 

-3.0 

“3.0 

3.0 



<u 

to 

aj 

U 

O 



< u 
3.3 A 
3.0 A 
2.7 A 
3.2 A 



2.1 

2.2 



3.4 A 
2*7 A 
2.7 A 
2.9 A 
2.1 S 
3.0 A 

2.3 S 

2.4 



22. Which component of the school plan do you find most effective for 
your learning? (Circle one) 

A. small group B. large group C- independent study D • laLoraiory 

2 j . Check the reasons for taking courses other than required courses: 

1 parent pressure 0 friend in course 

like teacher v 3 easy course 

course content 8 other (what? ) 

(46 omit) 

STUDENTS 

We want to find out how you feel about the senior high school. There are no 
"right" or "wrong" answers. Under the heading are pairs of words on a scale 
You are to make a check in the box which best represents how you feel that, 
word pair describes the senior high school. 



0 

40 



DULL 

STRICT 

PLEASANT 

HEAVEN 

HELPFUL 

GOOD 

WEAK 

FRIENDLY 

FUN 

EASY 

VALUABLE 

EXCITING 

REWARDING 

ZOO 



WHITE BEAR LAKE SENIOR HIGH SCHOOL 



□ 

zz. 

ZZ 

ZZ 



ZZ 

ZZ 

•ZD 

ZD 

ZZ 



ZZ 

ZZ 

ZZ 



CZ3 

1ZZ 



1 



ZZ 

ZZ 

ZZ 

r*i 

zz 



*i 



! * 



ZZ 

zz 



zz 

zz 

zz 



zz 

zz 

zz 

zz 



zz * zz 



INTERESTING 

LENIENT 

UNPLEASANT 

HELL 

HARMFUL 

BAD 

STRONG 

COLD 

DRUDGERY 

HARD 

WORTHLESS 

BORING 

PUNISHMENT 

MUSEUM 
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APPENDIX C 



FORMER STUDENT FOLLOW-UP 
QUESTIONNAIRE 



Your high school is interested in obtaining information about its former students. This information will enable 
school officials to assist students in planning their educational programs and in making career decisions. 

Please answer the following questions to the best of your ability. All answers will be summarized by group and 
your individual identity will not be revealed. 



DIRECTIONS: 

(1) Mark your responses to the questionnaire items on the enclosed follow up response card with a leaci 
pencil. Since these responses will be machine tallied, it is imperative that the item letters on the ques- 
tionnaire and on the response card correspond. 

(2) Answer aU questions. If a particular question is not relevant for you, mark the "not applicable" response. 

(3) Several of the questions require that you select a code number from the lists on the back page. Be 
certain to mark each digit of your selected code number. 

(4) Your high school may have enclosed an additional set of questions. If so, respond to these items 
beginning with item "AA" on your response card. 

(5) Use the back of the response card to write any comments or suggestions that will better explain your 
responses. 

(6) Return the response card and the current address card in the enclosed self-addressed envelope. Do not 
return the questionnaire. 



‘'PERSONAL INFORMATION 

A. What is your current marital status? 

(1) Single (3) Divorced (5) Widow 

(2) Married (4) Separated . (6) Widower 

B. How are you fulfilling your military obligation? 



(1) Not applicable (women) 


(4) Deferred 


(7) ROTC program 


(2) Not yet called 


(5) Six months reserve 


(8) Drafted 


(3) Exempt or rejected 


(6) Enlistment 


(9) Other 


In what branch of the military service are you serving? 




(1) Not applicable 


(4) Air Force 


(7) National Guard 


(2) Army 


(5) Marines 


(8) Other y ; 


(3) Navy 


(6) Coast Guard 





/ 



(7) Other 



L 1 V v M 



fS 



EDUCATIONAL INFORMATION 

D. What type(s) of post high school vocational training schools have you attended? (more than one possible) 

(1) Have not attended (5) On-the-job training 

(2) Area vocational-technical school (G) Military service school 

(3) Private trade school (7) Other 

(4) Private business school 

E. How many months of post high school vocational training have you completed? 

(1) None (3) Four to six months 

(2) One to three months (4) Seven to twelve months 

F . From the list of colleges and universities on the back page select the code number for the school that you 
first entered. (Mark the tens or first digit in the upper row on your response card and the units or second 
digit in the lower row). If you have not entered a college, use the code number "00" for this item. 

G. If you transferred, select the code number for the college or'univer si ty that you then entered. (Use the 
same procedure as for F). If you have not entered a college or transferred, use the code number "00" for 
this item. 

jCV 

H. What is your approximate college grade-point-average (GPA)? (A=^ 4.0). 



(1) Not apr : '-al»le 


(4) 2.5 to 2.9 


(7) 1 .4 and below 


(2) 3.5 to 4 0 


(5) 2.0 to 2.4 




(3) 3.0 to 3.4 


(6) 1.5 to 1.9 





I . How did you finance your post-high school vocational or college education? (more than one possible) 

(1) Not applicable (5) Part timework 

(2) Help from parents or relatives (6) Summer work 

(3) Scholarships or grants (7) Savings 

(4) Loans 

J. From the list of post high school vocational training and college majors on the back page select and mark 
the code number for your major. Use code number "00" if this item is not applicable. 



O 




OCCUPATIONAL INFORMATION 



K. Which of the following best describes your current job status? 

(1) Unemployed and seeking work (6) Housewife, not otherwise employed 

(2) Employed full time (7) Housewife, employed full time 

(3) Student, not otherwise employed (8) Housewife, employed part time 

(4) Student, employed part time (9) Other 

(5) In military service 



L. 



M. 



f you are employed full time, how well satisfied are you with your present job? 

1) Not applicable ' (4) Indifferent 

2 ) Completely satisfied (5) Somewhat dissatisfied 

3) Somewhat satisfied (9) Completely dissatisfied 



What were the]wo most important factors in obtaining 

/ 

(1) Not applicable 

(2) Family or friends 

(3) State employment bureau 

(4) Private employment agency 



full time employment? 

(5) Placement through training institution 

(6) High School experience 

(7) Personal search and application 




I 



COLLEGES AND l NIYEHSITIES 



UNIVERSITY OF MINNESOTA 

01 College of Agric., Forestry, & Home Ec. 

02 College of Liberal Arts 

03 College of Education 

04 Institute of T echnology 

05 General College 

06 Duluth 

07 Morris 

08 Crookston Tech. Institute 

09 U of M. Other 

MINNESOTA LIBERAL ARTS COLLEGES 

10 A ugsburg 

1 1 Bethel 

12 Carleton 

13 Concordia (Moorhead) 

14 Concordia (St. Paul) 

15 Dr. Martin Luther 

16 Gustavus Adolphus 

17 Hamline 

18 Lea 

19 Macalester 

20 Mpls. School of Art 

21 MacPhail College of Music 

22 St. Benedict 

23 St. Catherine 

24 St. John 

25 St. Mary, Winona 

26 St. Olaf 

27 St. Paul Bible 

28 St. Paul Seminary 

29 St. Scholastica 

30 St. Teresa 

31 St. Thomas 

39 Other, Minn. Lib. Arts College 

MINNESOTA STATE COLLEGES 

40 Bemidji 

41 Mankato 

42 Southwest, Marshall 

43 Moorhead 

44 St. Cloud 

45 Winona 

49 Other, Minn. State College 



MINNESOTA STATE JUNIOR COLLEGES 

50 Anoka-Ramsey (Coon Rapids) 

51 Austin 

52 Brainerd 

53 Fergus Falls 

54 Hibbing 

55 Itasca (Coleraine) 

56 Lakewood (White Bear Lake) 

57 Mesabi (Virginia) 

58 Metropolitan (Mpls.) 

59 Normandale (Bloomington) 

60 North Hennepin (Osseo) 

61 Northland (Thief River Falls) 

62 Rainy River (International Falls) 

63 Rochester 

65 Vermillion (Ely) 

66 Willmar 

67 Worthington 

79 Other Minn. State Jr. College 

MINNESOTA PRIVATE JUNIOR COLLEGES 

80 Bethany Lutheran (Mankato) 

81 Corbett (Crookston) 

82 Crosier Sem. (Onamia) 

83 Golden Valley Lutheran 

84 St. Clare ( Little Falls) 

85 St. Mary (Mpls.) 

89 Other, Minn. Private Jr. College ' 

OUT-OF-STATE COLLEGES & UNIVERSITIES 

90 State University 

91 State College 

92 Private college or university 

93 Junior college 

94 Military Academy 

98 Other Out-of-Slate college or university 

99 College or University outside of U.S. 



01 

02 

03 

04 

05 

06 

07 

08 

09 

10 
11 
12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 
39 



COLLLGK AND HOST-IIIGII SC HOOL 
VOCATION A UX HAIM NG MA.IOHS 



COLLEGE MAJORS 

Accounting 

Agriculture 

Art 

Biological Sciences 
Business 

Computer Science 
Conservation, Forestry 
Dentistry 

Elementary Education 

Engineering 

English 

Foreign Languages 

Home Economics 

Industrial Arts 

Journalism 

Law J 

Law Enforcement 

Mathematics or Statistics 

Medicine 

Music 

Nursing 

Philosophy 

Physical Education & Recreation 

Physical Science 

Psychology 

Social Sciences 

Speech and Drama 

Theology 

Veterinary Medicine 
Vocational Education 
Other, College Major 



POST -HIGH SCHOOL VOCATIONAL 
TRAINING MAJORS 

40 Agriculture-related occupation 

41 Airline Hostess 

42 Appliance Repair 

43 Barber ing 

44 Clerical and Secretarial 

45 Civil Highway Technology 

46 Clothing-related occupation 

47 Conservation Work , 

48 Construction Industry-related 

49 Cosmetology 

50 Data Processing Technology 

51 Dental Assistant 

52 Drafting Technology 

53 Electricity and Electronics 

54 Food-related occupation 

55 Health & Medical-related occupation 

56 Heavy Equipment Operation & Maintenance 

57 Law Enforcement 

58 Machine Trade occupation 

59 Mechanics, Auto & Other 

60 Photography 

61 Printing & Graphic Arts 

62 Radio Announcing 

63 Sales and Marketing 

64 Service-related occupations 

65 Shoe Repair 

66 Tailoring 

67 Watch Repair 

68 Welding 

69 Other, Post-High School Vocational Training 



FORM B 69 



C\i 

v£> 

nO 

CT' 

n£> 

O 

Ok 




FORMER STUDENT FOLLOW-UP 
QUESTI ONNAIRE 

Your high school is interested in obtaining information about its former students. This information will enable 
school officials to assist students in planning their educational programs and in making career decisions. 

Please answer the following questions to the best of your ability. All answers will be summarized by group and 
your individual identity will not be revealed. 



DIRECTIONS: 

(1 ) Mark your responses to the questionnaire items on the enclosed follow-up response card with a lead 
pencil . Since these responses will be machine tallied, it is imperative that the item letters on the 
questionnaire and on the response card correspond. 

(2) Answer all questions. If a particular question is not relevant for you. mark the "not applicable" response. 

(3) Several of the questions require that you select a code number from the lists on the back page. Be 
certain to mark each digit of your selected code number. 

(4) Your high school may have enclosed an additional set of questions. If so. respond to these items 
beginning with item "AA" on your response card. 

(5) Use the back of the response card to write any comments or suggestions that will better explain your 

responses. ^ 

(6) Return the response card and the current address card in the enclosed self-addressed envelope. Do not 
return the questionnaire. 



MARITAL INFORMATION 



ERIC 



;] 




A. 


What is your current marital status? 












(1) Single (3) Divorced 




(5) Widow 


:* 

i 






(2) Married (4) Separated 




(6) Widower 






B. 


How soon after leaving high school did you marry? 






■t 

j 


o 




(1) Not married 


(4) 


Seven months to one year 


> 


Q 




(2) Married during high school 


(5) 


1 3 months to two years 


v 


X 




(3) Within six months 


(6) 


25 months to three years 


j 


\ 


C. 


How many children do you have? 








n 




(1) None 


(31 


Two 


\ 

l 






(2) One 


(4) 


Three or more 


















EDUCATIONAL INFORMATION 










D. 


What type(s) of post-high school vocational training schools have you attended? (more 


r* 


ps. 




(1) Have not attended 


(5) 


On-the-job training 


V 

.-A. 


K 




(2) Area vocational-technical school 


(6) 


Military service school 








(3) Private trade school 


(7) 


Other 


■~x 

1 






(4) Private business school 






1 




- 









(7) Other 



How many months of post-high school vocational training 


have you completed? 


id 


None 


(5) 


13 to 18 months 


(2) 


One to three months 


(6) 


19 to 24 months 


(3) 


Four to six months 


(7) 


25 or more months 


(4) 


Seven to twelve months 







F. From the list of colleges and universities on the back page select the code number for the school that 
you first entered. (Mark the ten's or first digit in the upper row on your response card and the unit's 
or second digit in the lower row). If you have not entered a college, use the code number ' 00" for this 
item. 

G. If you transferred, select the code number for the college or university that you then entered. (Use the 
same procedure as in F). If you have not entered a college or transferred, use the code number "00" for 
this item. 

H. What was your main reason for transferring? 



id 


Not applicable 


(5) 


Changed educational objectives 


(2) 


Distance from home 


(6) 


Disliked the college 


(3) 


Financial reasons 


(7) 


Pre-planned transfer 


(4) 


Scholastic difficulty 


(8) 


Other 



I. What is your approximate college grade-point average (GPA)? (A =4.0) 



id 


Not applicable 


(4) 


2.5 to 2.9 


(7) 1.4 and below 


(2) 


3.5 to 4.0 


(5) 


2.0 to 2.4 




(3) 


3.0 to 3.4 


(6) 


1.5 to 1.9 





J. How many total academic years have you attended college? 

(1) None (3) One year (5) Three years 

(2) One half or less (4) Two years 

K. From the list of post-high school vocational training and college majors on the back page select the code 
number for your major. Use the code number "00" if this item is not applicable. 

L. How did you finance your post-high school vocational or college education? (more than one possible) 



id 


Not applicable 




(5) 


Part time and summer work 


(2) 


Help from parents or relatives 




(6) 


Savings 


(3) 


Scholarships or grants 




(7) 


G. 1. Bill 


(4) 


Loans 








If you left school before you reached your objective. 


what 


was the main reason? 


id 


Not applicable 




(5) 


Marriage 


(2) 


Scholastic difficulty 




(6) 


Changed objectives 


(3) 


Financial reasons 




(7) 


Other 


(4) 


Health 








What degrees or certificates do you hold? (more than 


one possible) 


id 


None 




(5) 


Bachelor's degree 


(2) 


Certificate of completion 




(6) 


Master's degree 


(3) 


Journeyman's card 




(7) 


Other 


(4) 


Associate of Arts degree 


zn 







OCCUPATIONAL INFORMATION 



0. 



Which of the following best describes your current job 


status? 




id 


Unemployed and seeking work 


(6) 


Housewife, 


not otherwise employed 


(2) 


Employed full time 


(7) 


Housewife, 


employed full time 


(3) 


Student, not otherwise employed 


(8) 


Housewife, 


employed part time 


(4) 


Student, employed part time 


(9) 


Other 




(5) 


In military service 









How many full time jobs have you held since you left high school? (Do not include summer jobs) 

(1) None (3) Two or three (5) Six or more 

(2) One (4) Four or five 



How well satisfied are you with your present full time job? 

(1) Not applicable (3) Somewhat satisfied 

(2) Completely satisfied (4) Indifferent 



(5) Somewhat dissatisfied 

(6) Completely dissatisfied 



What were the two most important factors in obtaining full time employment? 

(1) Not applicable (5) Placement through training institution 

(2) Family or friends " (6) High school experience 

(3) State employment bureau (7) Personal search and application 

(4) Private employment agency 



MILITARY INFORMATION 



S. How are you fulfilling or have you fulfilled your military obligation? 





(1 ) Not applicable (women) 


(4) Deferred 


(7) 


ROTC program 




(2) Not yet called 


(5) Six months reserve 


(8) 


Drafted 


T 


(3) Exempt or rejected 


(6) Enlistment 


(9) 


Other 


■" 


T. In what branch of the military service are you serving or have you served? 




j 


(1) Not applicable 


(4) Air Force 




(7) National Guard 


± ■ 


(2) Army 


(5) Marines 




(8) Other 


* 


(3) Navy 


(6) Coast Guard 








U. How long after leaving high school did you enter the military service? 








(1) Not applicable 


(3) Seven months to one year 




(5) 25 months to 


7 

* 


(2) Within six months 


(4) 13 months to two years 




three years 



■I 

j 



o 

[ERIC 



) 

t 



■i 






COU-EC.ES AND INI VERS I TILS 



UNIVERSITY OF MINNESOTA 

01 College of Agric.. Forestry, & Home Ec. 

02 College of Liberal Arts 

03 College of Education 

04 Institute of Technology 

05 General College 

06 Ouluth 

07 Morris 

08 Crookston Tech . Institute 

09 U of M, Other 

MINNESOTA LIBERAL ARTS COLLEGES 

10 Augsburg 

11 Bethel 

12 Carleton 

13 Concordia (Moorhead) 

14 Concordia (St. Paul) 

15 Or. Martin Luther 

16 Gustavus Adolphus 

17 Hamline . 

18 Lea 

19 Macalester 

20 Mpls. School of Art 

21 MacPhail College of Music 

22 St. Benedict 

23 St. Catherine 

24 St. John 

25 St. Mary, Winona 

26 St. Olaf 

27 St. Paul Bible 

28 St. Paul Seminary 

29 St. Scholastica 

30 St. Teresa 

31 St. Thomas 

39 Other, Minn. Lib. Arts College 

MINNESOTA STATE COLLEGES 

40 Bemidji 

41 Mankato 

42 Southwest, Marshall 

43 Moorhead 

44 St. Cloud 

45 Winona 

49 Other. Minn. State College 



MINNESOTA STATE JUNIOR COLLEGES 

50 Anoka-Ramsey (Coon Rapids) 

51 Austin 

52 Brainerd 

53 Fergus Falls 

54 Hibbing 

55 Itasca (Coleraine) 

56 Lakewood (White Bear Lake) 

57 Mesabi (Virginia) 

58 Metropolitan (Mpls.) 

59 Nor mandate (Bloomington) 

60 North Hennepin (Osseo) 

61 Northland (Thief River Falls) 

62 Rainy River (International Falls) 

63 Rochester 

65 Vermillion (Ely) 

66 Witlmar 

67 Worthington 

79 Other Minn. State Jr. College 

MINNESOTA PRIVATE JUNIOR COLLEGES 

80 Bethany Lutheran (Mankato) 

81 Corbett (Crookston) 

82 Crosier Sem. (Onamia) 

83 Golden Valley Lutheran 

84 St. Clare (Little Falls) 

85 St. Mary (Mpls.) 

89 Other, Minn. Private Jr. College 

OUT-OF STATE COLLEGES & UNIVERSITIES 

90 State University 

91 State College 

92 Private college or university 

93 Junior college 

94 Military Academy 

98 Other Out-of-State college or university 

99 College or University outside of U.S. 



COLLECT E AND POST- 1 1 Id I SCHOOL 
VOCATIONAL TRAINING MAJORS 



I 

I 



N* - • . 



[ 

* 



01 


COLLEGE MAJORS 
Accounting 


40 


02 


Agriculture 


03 


Art 


41 


04 


Biological Sciences 


42 


05 


Business 


43 


06 


Computer Science 


44 


07 


Conservation, Forestry 


45 


08 


Oentistry 


46 


09 


Elementary Education 


47 


10 


Engineering 


48 


11 


English 


49 


12 


Foreign Languages 


50 


13 


Home Economics 


51 


14 


Industrial Arts 


52 


15 


Journalism 


53 


16 


Law 


54 


17 


Law Enforcement 


55 


18 


Mathematics or Statistics 


56 


19 


Medicine 


57 


20 


Music 


58 


21 


Nursing 


59 


22 


Philosophy 


60 


23 


Physical Education & Recreation 


61 


24 


Physical Science 


62 


25 


Psychology 


63 


26 


Social Sciences 


a— vj 64 


27 


Speech and Drama 


,* 65 


28 


Theology 


66 


29 


Veterinary Medicine 


67 


30 


Vocational Education 


68 


39 


Other, College Major 


69 

q>°) 



POST HIGH SCHOOL VOCATIONAL 
TRAINING MAJORS 
Agriculture-related occupation 
Airline Hostess 
Appliance Repair '7 
Barbering 

Clerical and Secretarial 
Civil Highway Technology 
Clothing-related occupation 
Conservation Work 
Construction Industry-related 
Cosmetology 

Oata Processing Technology 
Oental Assistant $ 

Orafting Technolcwy 

E lectricity an4«jftffonjtcs 

Food-related ocQgwtion 

Health & McdicanWftitcd occupation 

Heavy Equipmen Operation & Maintenance 

Law Enforcement 

Machine Trade occupation 

Mechanics, Auto & Other 

Photography 

Printing & Graphic Arts 

Radio Announcing 

Sales and Marketing 

Service-related occupations 

Shoe Repair 

Tailoring 

Watch Repair 

Welding 

Other, Post-High School Vocational Training 






1 

T 

{ 

1 



t 

f 



i 

i 



AA 1. 



BB 2. 



CC 3. 



4. 



5. 



6 . 



7. 



8 . 



9. 



10 . 



If after graduating from high school you entered i :to a vocational, 
trade, or business school, how satisfied were you /ith the benefits 
derived from industrail arts, vocational educatin'., business education 
and/or home economics at White Bear Senior iligh School? 

(1) Not applicable (3) Somewhat satisfied (5) Somewhat dissnt. 

(2) Completely satisfied (4) Indifferent (8) Completely dis. 



Are you employed in an occupation in which you arc. using a vocational 
skill that you acquired in high school? 

(1) Yes (2) No (3) Not applicable 



Check those areas that you feel were given the proper amount of 
emphasis in the school curriculum. (More than one possible) 

(1) Art (5) Industrial Arts (9) Physical Ed. 

(2) Business Ed. (6) Math (10) Sciet ce 

(3) English (7) Mod. Languages (11) Social Studies 

(4) Home Ec. (8) Music (12) Vocational Ed. 



As a college or college-bound student, do you fe.^1 you were well 
prepared for college? 

(1) Yes (2) No (3) Not applicable 

If given your choice, would you elect to send yo :c children to 
White Bea?; Senior High School? 

(1) Yes (2) No 

Did White Bear Senior High School provide a vehicle for social 
involvement and growth? 

(1) yes (2) No 

Did you have an informal personal discussion witoi more than half 
of your teachers at White Bear Senior High School? 

(1) Yes (2) No 



Were the communication skills obtained at White Bear Senior High 
School adequate for daily living? 

(1) Yes (2) No 



Did your high school experiences enable you to develop self- 
discipline? 

(1) Yes (2) No 



Check three of the individuals listed below who 
significant role in your career development. 

(1) Mother (5) Elementary teacher (9) 

(2) Father (6) Junior High teacher (10) 

(3) Brother (7) Senior High teacher (11) 

(4) Sister (8) College teacher (12) 



you feel played a 

Jocnsalor 
Clergyman 
■’riend 
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APPENDIX D 



TARGET DATES 
March 1, 1970 



May 1, 1970 



June 15, 1970 



August 15, 1970 



September 15, 1970 
January 1, 1971 
February 1, 1971 
February 15, 1971 



March 10, 1971 



March 15, 1971 



U 



PRODUCT 

Evaluation Problem : 

No Pretest Data 
No Accessible 

Comparable School 



Performance Based 
Evaluation Proposal 



V 

Behavioral Objectives 
* based on program 
objectives for: 
Students 
Graduates 
Teachers 
Community 



Refined Objectives 

Tentative Instruments 
Community Interview 
Community Questionnaire 
Teacher Questionnaire 
Student Questionnaire 
TIES Graduate Questionnaire 
School Survey Questionnaire 
ITED 

On-site Observation 



Refined Instruments 
with Criterion Levels 



Testing Interviews 

i 

Statistical Data on 

Results of Instrumentation 

J/ 

Summary of Results of 
Objective, Criterion 
Level Achievement, and 
On-site Observation 



\/ 

Preliminary Report to 
Evaluation Committee 



Final Report - Board of 
Education 



PROCESS 



Strategy 

Decision 

(ERDC Evaluation Staff) 



Objective Formula t ion 
(ERDC Evaluation Staff 
& WBL Evaluation Comm.) 



Objective clarification; 
refinement ; Instrument 
selection & development 
(ERDC Evaluation Staff) 



Criterion Determination 
Ins tr umen t Ref inemen t 
(ERDC Evaluation Staff & 
WBL Evaluation Committee 



Data Gathering Decisions \ 

Data Coding, Tabulating 
and Compiling 



Data Interpretation 



Narrative : Summarization, 

Implications, and 
Recommend a t ions 



Refinement and modification 
of Report 



E9 



